-- Logs begin at Thu 2022-06-23 12:55:24 UTC, end at Thu 2022-06-23 13:57:34 UTC. -- Jun 23 13:25:23.063420 dv-cinder-815582-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 13:25:23.072350 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 13:25:23 2022] *** Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: nodename: dv-cinder-815582-10-iscsi Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: machine: x86_64 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: clock source: unix Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: pcre jit disabled Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: detected number of CPU cores: 4 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: current working directory: / Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: detected binary path: /usr/bin/uwsgi-core Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: your processes number limit is 47680 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: your memory page size is 4096 bytes Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: detected max file descriptor number: 2048 Jun 23 13:25:23.074371 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: lock engine: pthread robust mutexes Jun 23 13:25:23.075083 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: thunder lock: enabled Jun 23 13:25:23.075083 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 13:25:23.075083 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 13:25:23.117562 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: Python main interpreter initialized at 0x55eb5b3879c0 Jun 23 13:25:23.117562 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: python threads support enabled Jun 23 13:25:23.117562 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: your server socket listen backlog is limited to 100 connections Jun 23 13:25:23.117562 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: your mercy for graceful operations on workers is 90 seconds Jun 23 13:25:23.117886 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 13:25:23.117959 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: *** Operational MODE: preforking *** Jun 23 13:25:23.118271 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: *** uWSGI is running in multiple interpreter mode *** Jun 23 13:25:23.118271 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: spawned uWSGI master process (pid: 80360) Jun 23 13:25:23.118475 dv-cinder-815582-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 23 13:25:23.119545 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: spawned uWSGI worker 1 (pid: 80370, cores: 1) Jun 23 13:25:23.119545 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: spawned uWSGI worker 2 (pid: 80371, cores: 1) Jun 23 13:25:23.119545 dv-cinder-815582-10-iscsi devstack@keystone.service[80360]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 13:25:28.479017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:25:28.479017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: from cryptography.utils import int_from_bytes Jun 23 13:25:28.479846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:25:28.479846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: from cryptography.utils import int_from_bytes Jun 23 13:25:28.521076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:25:28.521076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: from cryptography.utils import int_from_bytes Jun 23 13:25:28.521658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:25:28.521658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: from cryptography.utils import int_from_bytes Jun 23 13:25:28.528715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:25:28.528892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:25:28.529124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] command line args: [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:25:28.529388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:25:28.529518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ================================================================================ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:25:28.529797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] admin_token = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.530036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_dir = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.530193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.530400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] config_source = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.530532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] debug = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.530758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.531088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.531274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.531551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.531796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_config_append = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_dir = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.532932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.533173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.533439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.533677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.533847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.534024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.534261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.534501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.534727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.534956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.535184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.535448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.535690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.535930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.536183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.536682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.536861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] publish_errors = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.537088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.537314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.537490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.537730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.537958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.538189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] standard_threads = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.538415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.538651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.538823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.538997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_journal = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.539172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_json = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.539355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_stderr = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.539541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] use_syslog = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.539770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.540025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.540262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.540517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.540756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.541003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.541234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.541477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.541710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.541952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.542194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.542443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.542674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.542915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.543251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.543521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.543767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.544003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.544253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.544503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.544746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.544979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.545228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.545486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.545732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.545974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.546201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.546428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.546654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.546885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.547127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.547386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.547617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.547844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.548087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.548332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.548565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.548808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.549035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.549267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.549499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.549726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.549953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.550179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.550407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.550640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.550885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.551118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.551379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.551599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.551834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.552075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.552321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.552549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.552783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.553017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.553247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.553479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.553711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.553937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.554182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.554414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.554654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.554883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.555138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.555398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.555629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.555863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.556096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.556358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.556593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.556835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.557078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.557311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.557542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.557772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.558013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.558244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.558476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.558716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.558971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.559203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.559460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.559693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.559924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.560179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.560415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.560651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.560882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.561124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.561361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.561591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.561821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.562049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.562273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.562498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.562729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.562954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.563190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.563451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.563693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.563925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.564174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.564428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.564664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.564895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.external = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.565122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.565411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.565637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.565865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.password = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.566090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] auth.token = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.566325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.566556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.566796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.567023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.567265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.567532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.567758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.567989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.568064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:25:28.568197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:25:28.568272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.568393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] command line args: [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:25:28.568477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.568662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:25:28.568737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.568841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ================================================================================ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:25:28.568917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.569097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] admin_token = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.569176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.569343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_dir = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.569420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.569534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.569616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.569717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] config_source = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.569829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.569910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] debug = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.570060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.570137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.570305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.570384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.570485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.570586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.570747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.570822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.571000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.571078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.571231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.571380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.571484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_config_append = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.571579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.571685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.571780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_dir = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.571871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.571979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.572073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.572166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.572268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.572386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.572537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.572630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.572710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.572876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.572968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.573041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.573155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.573229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.573358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.573488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.573602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.573679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.573852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.573929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.574083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.574168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.574326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.574442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.574609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.574725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.574853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.574931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.575097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.575181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.575328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.575458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.575582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.575824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.575909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.576054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] publish_errors = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.576133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.576284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.576368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.576510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.576587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.576706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.576782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.576920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.577009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.577154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.577231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.577391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] standard_threads = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.577467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.577624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.577712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.577861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.577944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.578213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_journal = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.578419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_json = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_stderr = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.578729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] use_syslog = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.578832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.578960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:25:28.579066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.579967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.580981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.581919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.582984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.583939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.584946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.585950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.586877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.587856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.588998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.589925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.590881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.591906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.592991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.593923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.594910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.595866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.596965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.597985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.598904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.599894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.600982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.601911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.602857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.603847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.external = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.604995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.password = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] auth.token = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.605938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.606943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.607934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.608864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609098 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.609966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.610946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.611929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.612934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.613955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.614968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:25:28.615822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.615822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.616055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.616186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.616310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.616526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.616771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.617016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.617264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.617521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.617766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.618034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.618272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.618508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.618739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.618974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.619203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.619464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.619707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.619959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.620209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.620440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.620688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.620935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.621170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.621587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.621881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.622175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.622355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.622588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.622827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.623077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.623324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.623583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.623822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.624073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.624323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.624556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.624789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.625038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.625286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.625523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.625759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.625995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.626231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.626471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.626728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.626959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.627205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.627473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.627720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.628335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.628335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.628587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.628717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.628837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.629059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.629305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.629549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.629794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.630040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.630284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.630513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.630759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.630996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.631231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.631489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.631723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.631968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.632230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.632464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.632718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.632948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.633195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.633432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.633668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.633905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.634152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.634396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.634628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.634865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.635105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.635378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.635672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.635911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.636167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.636420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.636657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.636928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.637195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.637433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.637670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.637918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.638147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.638396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.638645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.638895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.639142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.639414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.639662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.639908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.640154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.640387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.640634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.640880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.641127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.641373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.641794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.642030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.642282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.642549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.642781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.643031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.643264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.643542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.643794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.644032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.644263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.644495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.644727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.644978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.645231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.645482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.645731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.645970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.646208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.646445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.646580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.646709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.646796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.646916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.647023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.647154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.647429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.647678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.647918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.648161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.648406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.648651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.648888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.649127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.649361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.649606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.649853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.650083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.650326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.650625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.650884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.651128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.651396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.651637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.651883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.652121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.652358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.652644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.652880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.653126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.653363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.653609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.653846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.654092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.654328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.654571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.654801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.655042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.655278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:25:28.655473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:25:28.657116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.681450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.681683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.681900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.684658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.684889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.690574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.708613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.708812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.827632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.834352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.875911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.876148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.879191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.879451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.939969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.940855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.941036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.941188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.941261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.941465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.967122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.967310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.967579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.967819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.968804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.969025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.969243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.969466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.969645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.979728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.979898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.992563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.992859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.993936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.994066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.994194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.994320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:28.994320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:25:29.011003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.011195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:25:29.011325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.011511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:25:29.011656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.011730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:25:29.011804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:25:29.012185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.012832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.013052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.023710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.023835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.023982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.024114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.024226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.024338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.024527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.024654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.032737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.032862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.036034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.036161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.036322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.036449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.036613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.036755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.036872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.036965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.037931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.038825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.065086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.065212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.066685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.066813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.066973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.067105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.072230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.072354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.072512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.072642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.072776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.072869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.080155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.080278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.080440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.080578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.084886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.085012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.085214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.085296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.085444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.085537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.085701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.085792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.086843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.105963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.106197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.106373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.106519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.110826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.111293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.114681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.114961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.115088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.115372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.120009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.120349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.123688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.124032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.127523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.127817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.128896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.129024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.129202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.129480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.147825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.148192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.148317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.148416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.148551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.148710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.148803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.149106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.156700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.157009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.158428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.158687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.158814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.159017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.161772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.162059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.162321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.162947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.163229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.176407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.176533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.176734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.176864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.177798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.178085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.178856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.179148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.179479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.197290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.197438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.200656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.200786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.203932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.204059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.205579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.205706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.207242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.207394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.207545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.207669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.207825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.207907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.215220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.215533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.217231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.217429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.220461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.220589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.220735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.220864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.221003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.221280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.221407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.221561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.230484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.230612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.230807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.230940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.231072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.231155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.238846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.239043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:25:29.239139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.239928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.240991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.241978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.242102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.242102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.242337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.242461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.242593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:25:29.279491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eb5b3879c0 pid: 80371 (default app) Jun 23 13:25:29.280100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eb5b3879c0 pid: 80370 (default app) Jun 23 13:25:29.282860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0db1-79a0-44b7-bb32-fa96a9c07e4d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:29.283144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0db1-79a0-44b7-bb32-fa96a9c07e4d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:29.283461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0db1-79a0-44b7-bb32-fa96a9c07e4d None None] PATH_INFO: `/v3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:29.287707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Jun 23 13:25:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:36.998852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:36.999486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:36.999486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:37.003770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:37.010497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:37.010918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:37.011056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:37.084880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: INFO dbcounter [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] Registered counter for database keystone Jun 23 13:25:37.109830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG oslo_db.sqlalchemy.engines [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:25:37.117899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writer thread running {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:25:37.297177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG passlib.handlers.bcrypt [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80371) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 13:25:37.297500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG passlib.handlers.bcrypt [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80371) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 13:25:37.352743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:37.354308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:37.478908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 13:25:37.699829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:37.773984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: INFO dbcounter [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] Registered counter for database keystone Jun 23 13:25:37.795298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG oslo_db.sqlalchemy.engines [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:25:37.803309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writer thread running {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:25:37.926622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6b88-8437-440a-bee6-83bba87b7050 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:37.932208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:37.932875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:37.933157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:37.933445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:37.942776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:37.994122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 13:25:37.994392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ec5d-296e-48c3-8718-44a872082269 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:38.004716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 23 13:25:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:25:38.014524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:38.035272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d019d1-a2fe-409f-8709-288b28f28a7b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:38.041045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:38.042195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:38.042477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:38.042751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] PATH_INFO: `/v3/projects/ee8652e385f24bd9be7726e25f653946` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:38.046996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee8652e385f24bd9be7726e25f653946)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:38.101489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 13:25:38.101828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf0fbe-945c-4689-9716-6e245cebff75 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:38.106572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Jun 23 13:25:38 2022] GET /identity/v3/projects/ee8652e385f24bd9be7726e25f653946 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:40.111275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da338-be68-4c80-a9bd-3171d7177d79 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:40.111723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da338-be68-4c80-a9bd-3171d7177d79 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:40.111821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da338-be68-4c80-a9bd-3171d7177d79 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:40.116218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:40.122925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:40.123409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:40.123630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:40.144615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:40.146145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:40.156337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 13:25:40.179262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8da338-be68-4c80-a9bd-3171d7177d79 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:40.196412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8da338-be68-4c80-a9bd-3171d7177d79 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:40.202129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:40.202764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:40.203045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:40.203319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:40.211297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:40.213109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445ab4-35d2-4e1d-9243-7342aafe51d4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:40.222591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 23 13:25:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:25:40.230954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:40.245690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4002a-2888-4b05-a663-7d8a25a2e30f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:40.252541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:40.253413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:40.253693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:40.253969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:40.255557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:40.257399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce76bd-db41-4fb6-9729-db4d4e7b0d6a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:40.258950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Jun 23 13:25:40 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:42.295769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3f3c-ca84-4d69-8c54-d9781272eebe None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.296328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3f3c-ca84-4d69-8c54-d9781272eebe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.296328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3f3c-ca84-4d69-8c54-d9781272eebe None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.297704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:42.302906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.303327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.303454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.320563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:42.321726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:42.355099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bcc26-c162-4242-959e-8e51814f2b10 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.355436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bcc26-c162-4242-959e-8e51814f2b10 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.355736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bcc26-c162-4242-959e-8e51814f2b10 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.357297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:42.362206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.362437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.362714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.403276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG passlib.handlers.bcrypt [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80370) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 13:25:42.403771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG passlib.handlers.bcrypt [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80370) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 13:25:42.406336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:25:42.429530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.448738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:42.450361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:42.452912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:42.532834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0a1b-575b-4c6e-a0f7-93e4489c078d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:42.551762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:42.566436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:42.567242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.567548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.567837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.573682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.579544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:42.590793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:42.592243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:42.598242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:25:42.598907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.675287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cc8b7-45eb-423f-b132-fd0bf79dfbf0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:42.677710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:42.678946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:42.697654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64813121-cb33-483c-96bf-2e147cdce3c2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:42.714219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:42.715139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.715445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.715723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.731977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:42.732653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.733007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.733291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.734058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:42.734368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:42.735835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:42.747413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:42.752928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.784139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:42.785673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:42.849606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1887c2-cf0d-4d04-adbc-f2cccb547eeb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:42.881266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:25:42.886965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:42.887107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.887894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:42.888180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:42.888455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:42.889690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:42.889812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:42.891310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:42.893025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:42.898383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:42.913263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:42.984762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e545-490a-4eba-aa5f-69a9a8d2c998 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:42.998893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e51de8-d71f-473d-a26c-abf264c48ada None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:43.020375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:43.021187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:43.021473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:43.021751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:43.032668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:43.033467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:43.033754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:43.034025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:43.035204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:43.036716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:43.038548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:43.040246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:43.041731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:43.043986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:25:43.062465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:43.063316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:43.064161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:25:43.064161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:25:43.064161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:25:43.064161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:25:43.064161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:25:43.070520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:43.125071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:43.134834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:43.145321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fc86d-462c-4e76-a74b-ca7dc096b3a8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:43.177021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4ec4-5160-4283-9b84-05354ced39a5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:43.178790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:43.179483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:43.179769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:43.180041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:43.180883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.domain.id=default, user.id=2dee5b081bb1404bb27ed23c7dae2bf0) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:43.181191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:43.182654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf30d5-5f05-4361-8582-7b20284bf527 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:43.189646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 23 13:25:43 2022] GET /identity/v3/role_assignments?user.id=2dee5b081bb1404bb27ed23c7dae2bf0&scope.domain.id=default&role.id=77bb21c1be16493181bb82f412685ca2 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:43.212256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:43.212944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:43.213228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:43.213504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:43.214255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:43.214561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:43.216396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42678eb0-4861-4470-afcf-b058b34551c3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:43.237303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:45.411672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26113f6-46eb-4715-81e2-3869163556eb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.412703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26113f6-46eb-4715-81e2-3869163556eb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.413288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26113f6-46eb-4715-81e2-3869163556eb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.414893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:45.420495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79215-752c-4504-8927-fbcad8ee39e1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.421317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79215-752c-4504-8927-fbcad8ee39e1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.421800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79215-752c-4504-8927-fbcad8ee39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.447528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-82b79215-752c-4504-8927-fbcad8ee39e1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:45.449079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-82b79215-752c-4504-8927-fbcad8ee39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:45.524928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:45.563499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26113f6-46eb-4715-81e2-3869163556eb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:45.698167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26113f6-46eb-4715-81e2-3869163556eb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:45.736936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa14d-76d9-4104-8c54-143854aea643 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.737697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa14d-76d9-4104-8c54-143854aea643 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.738171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa14d-76d9-4104-8c54-143854aea643 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.740100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:25:45.743776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:45.743776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.743776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.743776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.746309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead3a4-8d3c-4aca-b412-19535ec0ab4f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.746954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead3a4-8d3c-4aca-b412-19535ec0ab4f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.747478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead3a4-8d3c-4aca-b412-19535ec0ab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.763690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:45.774426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-23ead3a4-8d3c-4aca-b412-19535ec0ab4f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:45.775959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23ead3a4-8d3c-4aca-b412-19535ec0ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:45.780773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:45.781627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:45.782423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:45.785655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 13/25] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:45.791408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:45.799129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:45.855264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:45.889984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:45.897247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dcb06-cf43-4d4b-af38-db2ec929d4d9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.897754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dcb06-cf43-4d4b-af38-db2ec929d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.898225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dcb06-cf43-4d4b-af38-db2ec929d4d9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.899758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:45.905036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:45.905564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:45.906106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:45.932211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:45.933755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:46.034483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab16fdb-8887-4e5a-a02e-9d14625bbd77 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.038023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:25:46.039217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.105895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.109036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.115382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.115382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.115382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:46.115382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.115382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.134308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:46.135357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.191775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ea16d-4ebd-4238-a773-7e3168a5dd7b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.198876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.215662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.228487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.229468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.229880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.230328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.231207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.232860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061ee4-95fb-4f0a-97ce-9501bfa8d5e1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.260144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af865-e1c7-41a9-b2d2-b5f1b3951d02 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.303685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.304430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.304719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.304999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.316609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.318338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:25:46.339564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:46.340431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:46.341625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:25:46.341625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:25:46.341625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:25:46.341625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:46.343479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:46.344593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.371832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 23 13:25:46 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:46.373565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5b6-86ab-41ba-9dd3-40bf439a81af None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.373964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5b6-86ab-41ba-9dd3-40bf439a81af None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.374380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5b6-86ab-41ba-9dd3-40bf439a81af None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.375843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 17/32] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:46.376705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe5b6-86ab-41ba-9dd3-40bf439a81af None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.476412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8b38-ca73-42dc-a4db-8299a5781d3b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.496389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.513789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe5b6-86ab-41ba-9dd3-40bf439a81af None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.517958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.518747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.519134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.519555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.520982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.522707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabef6e-ac1f-48c7-9101-7f1f85d9099a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.525078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 16/33] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:46 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:46.526044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.531187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.531558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.551126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:46.552607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:46.577033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.577658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.577943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.578223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.579614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:46.579932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.583052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.603318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 18/34] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:46.604763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.640889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.676913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 17/35] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:46.677889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.728609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991c06a-f966-4526-ac96-656bfd057d26 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.771452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.772271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.772609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.772899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.774462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.776173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.777980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 19/36] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:46.778745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:46.801026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c75ca-946d-4334-b73e-d26fa84ecca4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.827825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.859517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.860306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.860590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.860869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.861608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.863384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f1a42-b857-4766-abf7-87ac4df07b74 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.904199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:46.912578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04634-97d5-47d2-9472-bc4306913e25 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:46.951578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:46.952523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:46.952943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:46.953318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:46.954237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:46.955771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:46.972460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 20/37] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 23 13:25:46 2022] POST /identity/v3/roles => generated 225 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:46.973366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:47.069602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 18/38] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:25:46 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:47.092176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b5eb6-1b06-4a3c-8941-c84902b80ef3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:47.092768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9c64-4c28-450f-b7ca-1818aa5080e9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.093064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9c64-4c28-450f-b7ca-1818aa5080e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.093348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9c64-4c28-450f-b7ca-1818aa5080e9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.094936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 19/39] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:25:47.101324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9c0b-2e0d-4d6d-bd75-c1960f2c3d15 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.103095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9c0b-2e0d-4d6d-bd75-c1960f2c3d15 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.103650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9c0b-2e0d-4d6d-bd75-c1960f2c3d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.148167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d1dc9c0b-2e0d-4d6d-bd75-c1960f2c3d15 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:47.149928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d1dc9c0b-2e0d-4d6d-bd75-c1960f2c3d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:47.184512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:47.185792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.186429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.186679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] PATH_INFO: `/v3/domains/default/users/2dee5b081bb1404bb27ed23c7dae2bf0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.192312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2dee5b081bb1404bb27ed23c7dae2bf0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:47.194285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e63ab1-e3ff-42af-a51e-984864c9ed23 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:47.231906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 21/40] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Jun 23 13:25:46 2022] PUT /identity/v3/domains/default/users/2dee5b081bb1404bb27ed23c7dae2bf0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:25:47.280324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:25:47.286529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029eb2-a6e4-43e4-b942-fb0811f083c5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.286888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029eb2-a6e4-43e4-b942-fb0811f083c5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.287300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029eb2-a6e4-43e4-b942-fb0811f083c5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.289178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 22/42] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:47.294654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.294939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.295218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.308358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37029eb2-a6e4-43e4-b942-fb0811f083c5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:47.318583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:47.320358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:47.329985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:47.413531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:47.437954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:47.452300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37029eb2-a6e4-43e4-b942-fb0811f083c5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:47.466398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:47.491407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:47.492105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.492387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.492666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.493456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:47.494915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:47.511599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 23 13:25:47 2022] POST /identity/v3/roles => generated 223 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:25:47.661324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18f51-df7f-4add-8e85-fa5c6d6fd265 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:47.700222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:47.701340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.701340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.701621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.702807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:47.704512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea82e3-4c9b-421b-be30-4c55e4c5f597 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:47.706134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:47.712091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:47.788568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:47.814521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f19a-545e-4d66-b8da-75150a762be9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:47.849167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:47.849830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:47.850120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:47.850397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:47.851131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:47.852649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57027e1a-5e02-49e1-b32a-144e15f7c563 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:47.880486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:25:47 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:49.287075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3adb1-bccc-4f23-9c9f-03d7bffef6b1 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.287661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3adb1-bccc-4f23-9c9f-03d7bffef6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.287661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3adb1-bccc-4f23-9c9f-03d7bffef6b1 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.289080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:49.294351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.294778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.294936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.312512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:49.314057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:49.383930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:49.407189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3adb1-bccc-4f23-9c9f-03d7bffef6b1 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:49.504318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:49.511660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3adb1-bccc-4f23-9c9f-03d7bffef6b1 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:49.545419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:49.546267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.546558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.546837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.557063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:49.564890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:49.565855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:49.566639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:49.572366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:49.737871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:49.785153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1999f-d28d-43a0-9c0f-198b43bca6b0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:49.820893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:49.821580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.821866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.822152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.822922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:49.823238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:49.824676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0e234-4adc-4b22-9fe3-bf0bd83e9df4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:49.836637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:49.842728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:49.882843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3335c7-11da-4a67-803a-64630cb63e89 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.883142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3335c7-11da-4a67-803a-64630cb63e89 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.883425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3335c7-11da-4a67-803a-64630cb63e89 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.884833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 27/51] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:49.889623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.889943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.890209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.907073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:49.908309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:49.944197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f9a0-2d85-45e7-b757-09c794cb524c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:49.974444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:25:49.978668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:49.979587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:49.979871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:49.980145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:49.981350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:49.982865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:49.984541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:49 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:49.990117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:49.997386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:50.022147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:50.040887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:50.094886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45063-6c70-4841-aea2-c31c23d4b7fe None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:50.098043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135c31-03fc-4998-bc98-c29bb60cb3ea None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:50.132130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:50.132717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:50.132936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:50.133215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:50.133486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:50.133569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:50.133801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:50.134083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:50.134656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:50.135279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:50.136188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:50.136830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:50.137814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:50.138524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:50.143495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:50.143953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:50.238112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:50.248238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466140a-e96b-4160-9d32-b3773ac2a3c0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:50.248487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1c4b-92fc-44d5-b5ac-e7a89ea3cb24 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:50.265240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:50.282220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:50.282392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:50.282892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:50.283058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:50.283181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:50.283360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:50.283501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:50.283652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:50.284225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:50.284489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.domain.id=default, user.id=2dee5b081bb1404bb27ed23c7dae2bf0) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:50.284805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:50.285716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf8ac-57f0-4a64-b590-7e5a1a141bca None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:50.286253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341c7d-c22f-43c5-9a4d-f0c865f2b1df None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:50.294204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 30/56] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 23 13:25:50 2022] GET /identity/v3/role_assignments?user.id=2dee5b081bb1404bb27ed23c7dae2bf0&scope.domain.id=default&role.id=77bb21c1be16493181bb82f412685ca2 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:50.312642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 23 13:25:50 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:25:52.339191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167837ac-bc55-49ce-945b-2044b3165ada None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:52.339768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167837ac-bc55-49ce-945b-2044b3165ada None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:52.339768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167837ac-bc55-49ce-945b-2044b3165ada None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:52.341538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 31/58] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:52.348026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:52.348703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:52.348884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:52.370749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:52.371908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:52.444979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:52.472779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167837ac-bc55-49ce-945b-2044b3165ada None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:52.590869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167837ac-bc55-49ce-945b-2044b3165ada None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:52.626133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:52.626938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:52.627225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:52.627525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:52.628852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:52.630315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa17dc5-ac81-4ab4-a983-2157084ee32f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:52.631947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 32/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:52.640103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:52.716804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:52.745373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e63ac-e9cd-429d-a271-aedbd7868be4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:52.779959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:52.780630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:52.780909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:52.781186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:52.781902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:52.783387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e04d8-fbad-43be-b12b-c66c18e05a7e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:52.810495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:25:52 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:55.909450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7954-6382-4ae6-9de7-cb9e03e6c73b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:55.910000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7954-6382-4ae6-9de7-cb9e03e6c73b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:55.910000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7954-6382-4ae6-9de7-cb9e03e6c73b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:55.911404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 33/62] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:55.916738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23458-8f95-46d3-a7cc-0c4f19f06c45 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:55.917119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23458-8f95-46d3-a7cc-0c4f19f06c45 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:55.917336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23458-8f95-46d3-a7cc-0c4f19f06c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:55.936520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a3e23458-8f95-46d3-a7cc-0c4f19f06c45 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:55.937733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a3e23458-8f95-46d3-a7cc-0c4f19f06c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:56.025934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:56.028145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d597a-fbdc-4a13-9aed-65231d0b7f34 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.028666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d597a-fbdc-4a13-9aed-65231d0b7f34 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.029143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d597a-fbdc-4a13-9aed-65231d0b7f34 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.031061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 34/64] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:56.035994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f66aa-258c-4580-b78e-72060416b31f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.036502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f66aa-258c-4580-b78e-72060416b31f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.037017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f66aa-258c-4580-b78e-72060416b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.049010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d597a-fbdc-4a13-9aed-65231d0b7f34 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.061502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cd5f66aa-258c-4580-b78e-72060416b31f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:56.062996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cd5f66aa-258c-4580-b78e-72060416b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:56.157705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.177987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.197865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:56.209607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab690-c570-4244-8d10-408c1c1b4532 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.210198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab690-c570-4244-8d10-408c1c1b4532 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.210680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab690-c570-4244-8d10-408c1c1b4532 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.212655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 32/66] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:56.225458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ab690-c570-4244-8d10-408c1c1b4532 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.246580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d597a-fbdc-4a13-9aed-65231d0b7f34 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.290235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.291348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.291654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.292181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.307754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-da4f3d3c-e18d-4627-8282-6859498f4fb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:56.324991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:56.325870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:25:56.326733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 35/67] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:56.328380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904517-8dff-4389-aa46-63be209fc141 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.328665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904517-8dff-4389-aa46-63be209fc141 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.328946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904517-8dff-4389-aa46-63be209fc141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.339387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ab690-c570-4244-8d10-408c1c1b4532 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.348898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-97904517-8dff-4389-aa46-63be209fc141 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:56.350476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-97904517-8dff-4389-aa46-63be209fc141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:56.380030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.380868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.381307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.381430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.392761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:56.401042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:56.401900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:56.402682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 33/68] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:25:56.403317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ffbc-3e0a-4964-88c7-9c49b0b02601 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ffbc-3e0a-4964-88c7-9c49b0b02601 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ffbc-3e0a-4964-88c7-9c49b0b02601 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 37/70] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:56.431463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ffbc-3e0a-4964-88c7-9c49b0b02601 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.460566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.476462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.514638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5a994-b150-4250-b174-e13c99abc691 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.543773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ffbc-3e0a-4964-88c7-9c49b0b02601 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.550338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.551016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.551299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.551603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.552361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:56.552984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:56.554064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d58fb-3149-49c1-b669-2f759ab18d3c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:56.562782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 34/71] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:56.563826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.564112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.564385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.580372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:56.581564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:56.586650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.587620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.588097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.588565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.589596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:56.590133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:56.592325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:56.601525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 38/72] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:56.602723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.655924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 35/73] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:56.656781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.701324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.710809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.714001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309d685-e3bb-4f03-94a7-a47b3291779d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.748441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.749238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.749520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.749800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.759605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:56.760182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184227-9e92-466e-b982-3f884d028c17 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:56.767265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:56.768159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:25:56.768911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:56.769528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.798635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.799558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.799844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.800123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.813940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:56.815444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc07868-1c75-41e3-b555-279268090d9a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:56.817148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:56.818417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af206f-e6a4-4a4c-95d2-0e417163af8f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.818709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af206f-e6a4-4a4c-95d2-0e417163af8f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.818991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af206f-e6a4-4a4c-95d2-0e417163af8f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.820255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 37/76] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:25:56.824256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af206f-e6a4-4a4c-95d2-0e417163af8f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.872765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e03f-ea27-4cdd-a545-340605f7b96d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.906262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.907149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.907462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.907733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.908963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:56.910410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:56.916507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 40/77] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:56.916507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:56.918077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.923854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af206f-e6a4-4a4c-95d2-0e417163af8f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:56.942283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:56.957384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:56.958138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:56.958425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:56.958703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:56.969129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:25:56.976894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:25:56.977811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:25:56.978575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 38/78] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:25:56.979230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.018844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12fde-6635-485e-8c18-d99198267bc6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.050616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.051286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.051600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.051879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.052629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:57.052945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.054330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9ffca-27f3-4781-90d4-10797bb43f88 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.062222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 41/79] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.063472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.063800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.064045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.079527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:25:57.080138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342d57-eb29-4512-997b-b4d7e5285226 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.080716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:57.118009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.118683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.118972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.119251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.146912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.150739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 42/80] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:25:57.163564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.173790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.187900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.189424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.249944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128459c-1490-4004-9476-f17b97a962d0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.282032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.282685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.282963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.283238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.289326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 39/81] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:25:57.290165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.346872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.355963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.357466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.378049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.387782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d97438-c479-46ef-b84a-72ad8b9a2629 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.422303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.422983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.423271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.423580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.424335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:57.424643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.426051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.433959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 40/82] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.434733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.457463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:25:57.458308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.533798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7f20-1daf-4add-97cc-78b6240b1430 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.552897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8769f6d-3c05-4015-885c-0fb85cfcdf3a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.555312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.567649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.568512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.568799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.569076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.570282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.571804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.573679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 41/84] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.574224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.578580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.588581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.589391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.589663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.589942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.591590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.593128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.594782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 44/85] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.595565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.676628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52acee-a972-4cbe-baa9-d4d2089322d7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.694827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ee151-b4ec-4b09-9552-2967771af9dd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.709444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.710326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.710611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.710900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.712134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.713607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.715329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 42/86] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.716464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.729451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.730337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.730618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.730892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.732115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.733647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.735278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 45/87] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.736057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.775161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.790848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.816565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2a299-e808-4e7f-8ba3-41385994dc79 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.833094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5cd7-7c4f-4ae5-aab5-17f5ed07419b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.850052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.850927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.851215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.851533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.852745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.854226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.855964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 43/88] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:57.856702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:57.867000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.867767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.868119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.868464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.934769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.936304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.952349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3f06-860d-471d-8e4a-4533f51112c8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:57.977717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:57.986634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:57.987306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:57.987623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:57.987900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:57.988624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:57.990080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:57.991825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.009311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 44/89] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:25:57 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:25:58.010124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.044549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 46/90] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:25:58.045583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.128522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a055-76e3-412e-8bb8-0ae374b9b09b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.178405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.179178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.179456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8669-0b31-4208-8926-12f2268a9e4a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.179557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.179773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.180623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=51c51146274043308cc062f293d361dd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:58.180946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.182444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.189803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=51c51146274043308cc062f293d361dd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:58.190928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.222930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.224127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.224607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.225056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.252398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.261961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.315783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.317271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.317712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039a96-bcc4-4ba0-a574-7259d1dbc53f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.361709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.362389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.362681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.362965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.363868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=51c51146274043308cc062f293d361dd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:58.364187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.365702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.375425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 46/92] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=51c51146274043308cc062f293d361dd&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:58.376244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.456641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 47/93] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:25:58.466943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.498819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3163f6-f911-4baf-9ad4-d22796a592f1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.510938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.531300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.538642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.540121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.540605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.541135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.542627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.544341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.546478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 47/94] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:58.553169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.600419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532b0e-9cb4-4b40-a9e8-e1ed52bbacbb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.673376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52caac-d367-4b2f-9e2a-7c3a4261e200 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.684095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.686497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.687654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.688312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] PATH_INFO: `/v3/projects/05b2316a29804ca2ba2a37554933cacd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.691129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] RBAC: Authorizing `identity:get_project(project_id=05b2316a29804ca2ba2a37554933cacd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.693627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.696356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 48/95] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/projects/05b2316a29804ca2ba2a37554933cacd => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:25:58.704115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:58.736784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.737846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.739266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.739773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.742152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=51c51146274043308cc062f293d361dd, user.id=2dee5b081bb1404bb27ed23c7dae2bf0) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:58.744318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.746011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0b281-3887-407a-914c-50c9b4435bdd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.758060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 48/96] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/role_assignments?user.id=2dee5b081bb1404bb27ed23c7dae2bf0&scope.project.id=51c51146274043308cc062f293d361dd&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:25:58.838584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd90-7804-4f11-91d5-c2099fbad480 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:58.866673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:58.878484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:58.879413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:58.879832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:58.880241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:58.881294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=05b2316a29804ca2ba2a37554933cacd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:25:58.881758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:58.883640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c1da-292c-45f5-95c0-c334c36d283f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:58.890427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 49/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:25:58 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=05b2316a29804ca2ba2a37554933cacd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:00.995079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db61e7-be0c-4a4e-ad75-c708d7040111 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:00.995632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db61e7-be0c-4a4e-ad75-c708d7040111 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:00.995708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db61e7-be0c-4a4e-ad75-c708d7040111 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:00.997360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 49/98] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:01.003322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.003890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.003890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.024487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:01.025715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:01.110128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 50/99] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:01.135173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6b4b-a036-4103-a001-19713885d1c6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.135490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6b4b-a036-4103-a001-19713885d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.135764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6b4b-a036-4103-a001-19713885d1c6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.137170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 50/100] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:01.142283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.146347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.146642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.146922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.172606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:01.173811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:01.250434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:01.307201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8269bf-fb5f-48fe-b9ad-39eb2acde755 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.312888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:01.337604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:01.347717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.348429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.348624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.348862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.349144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.362977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:01.371088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:01.372030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:01.372853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:01.380726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 51/102] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:01.387698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.487307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aaee-dcd1-4454-b01c-7409c5501599 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.523255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.523883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.524156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.524431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.525185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:01.525492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:01.526902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3317-8adc-4209-b51e-8733dea5a84a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:01.534047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc4b9-97f1-409a-8a60-6efc83dbc01d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.535123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 52/103] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:01.536429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2990f-eac4-4528-b3c1-a459d57d70fa None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.536659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2990f-eac4-4528-b3c1-a459d57d70fa None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.536927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2990f-eac4-4528-b3c1-a459d57d70fa None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.538163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 53/104] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:01.543026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2990f-eac4-4528-b3c1-a459d57d70fa None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.591860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:01.601399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.602248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.602558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.602812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.605240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:01.606736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97947c-8e0e-4fb2-9a52-7b5b035aa4f3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:01.608570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 52/105] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:01.609745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69090-9faa-480c-b143-a8e15efa9619 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.610028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69090-9faa-480c-b143-a8e15efa9619 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.610303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69090-9faa-480c-b143-a8e15efa9619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.647762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-08b69090-9faa-480c-b143-a8e15efa9619 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:01.649606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-08b69090-9faa-480c-b143-a8e15efa9619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:01.667634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2990f-eac4-4528-b3c1-a459d57d70fa None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.699699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:01.705913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.707147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.707680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.708151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.709617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:01.711407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:01.713687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 54/106] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:01.714727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.734066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 53/107] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:01.743709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd13e1-0d90-45f7-bf42-84c2480b3383 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.743709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd13e1-0d90-45f7-bf42-84c2480b3383 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.743709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd13e1-0d90-45f7-bf42-84c2480b3383 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.743709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 54/108] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:01.743709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd13e1-0d90-45f7-bf42-84c2480b3383 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.834478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4641c6-275f-4a99-bc7f-2cb670f372d3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.845249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:01.851072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd13e1-0d90-45f7-bf42-84c2480b3383 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:01.873217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.874119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.874552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.874988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.875750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:01.877239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bee34e-316e-47d9-81b4-49df9f98274f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:01.886026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:01.886967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.887358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.887625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.888843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:01.890304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fe6ae-e042-49f2-8dbf-d0507523c6fb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:01.892040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 55/109] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:01.893169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.893454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.893731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.909343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 55/110] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:26:01 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:01.915629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:01.915629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:01.916971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f825-1408-4f36-a814-d75f63ffa6a4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:01.917267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f825-1408-4f36-a814-d75f63ffa6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:01.917552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f825-1408-4f36-a814-d75f63ffa6a4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:01.919110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 56/111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:01.928372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f825-1408-4f36-a814-d75f63ffa6a4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:01.957442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.000431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 56/112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:02.002241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.084898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f825-1408-4f36-a814-d75f63ffa6a4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.116834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d9da1-f1c8-4353-9155-33ef404edc0e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.131856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.132669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.132951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.133224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.147599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b5470e98-2b7a-4c60-b2c0-e3ce8852bf97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:02.155390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:02.156509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:02.157514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 57/113] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:02.158309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.158309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.158309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.165183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.166540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.166971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.167436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/users/bab5072763ec4572ae0e1127303e56ad/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.170284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, user_id=bab5072763ec4572ae0e1127303e56ad, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:02.172021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:02.180246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:02.181448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:02.195105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:02 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/users/bab5072763ec4572ae0e1127303e56ad/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:02.196013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.200596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.231452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.287993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 58/115] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:02.288903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.329147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6464306-4a13-4e14-ad68-4309ebd2b5f4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.369774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.370526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.370813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.371093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.384057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0c9f0a57-1170-4429-8ce5-26599c3e4cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:02.393986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:02.395129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 58/116] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:02.396611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ed7a-11dc-4091-b366-66c84a2ef3fc None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.398227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ed7a-11dc-4091-b366-66c84a2ef3fc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.398227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ed7a-11dc-4091-b366-66c84a2ef3fc None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.398227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 59/117] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:02.398707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5ed7a-11dc-4091-b366-66c84a2ef3fc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.406058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d04a5-88ee-4747-90bb-555a178f840e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.458116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.459194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.459613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.459999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.460765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:02.461076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:02.462627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:02.471749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 59/118] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:02.472904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.494877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.511278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.525267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5ed7a-11dc-4091-b366-66c84a2ef3fc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.560982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.561844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.562187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.562473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.573622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9eaf4966-6e60-49d8-9ff5-cb98d05dc4f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:02.581975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:02.582817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:02.583636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 60/119] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:02.584822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.584822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.585051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.604501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9dba9-b8e4-4a04-a5b8-26d0f0132ea6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.607127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:02.608425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:02.645812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.646991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.647484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.647932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.649139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:02.650549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:02.652173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:02.663737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 60/120] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:02.664908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.686303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 61/121] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:02.687369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.770501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.780681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:02.805428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bf0d-5d74-4772-a6c5-e9f339405f91 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.808292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fc60-632d-4194-915c-6a499a557f61 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.849422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.850294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:02.850655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.851120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.851482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:02.851739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.851943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:02.852332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] PATH_INFO: `/v3/users/ea4dbe6463f944a081be741c6b19c377` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:02.853029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:02.853506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:02.855154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:02.864716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 62/122] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:02.865927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.874589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4dbe6463f944a081be741c6b19c377)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:02.876329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:02.878364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 61/123] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/users/ea4dbe6463f944a081be741c6b19c377 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:02.879248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:02.979654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c64d4-736c-41b3-a3ba-85ab3a1472f3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:02.995944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5aad2-19ee-4180-b7e0-27e680df5347 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.010268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.017355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.018362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.018791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.019220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.030736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:03.038654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:03.039570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:03.040385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 62/124] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:03.041023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.042091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.043696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.044352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.044832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.047291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.049141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.051525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 63/125] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:02 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.052554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.067090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.158020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9aa94-de06-4293-8f0b-3b2107e39c0b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.191098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752550-2fca-4ae6-a952-d87d57fd9060 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.192533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.193526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.193960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.194979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.195866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.197426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.203797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 63/126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.203797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.234427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.235147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.235577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.235950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.280965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.314824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.316874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.329759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.334386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a083-b78b-4eeb-9e14-3095e6f54613 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.382034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.383372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.383747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.384121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.385250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:03.385680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.388085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.399668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 64/127] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.400918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.434291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 64/128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:03.435696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.518328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6265bd-50ad-48dd-9d2f-15b7d2767139 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.546524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.564127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.566006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.566733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.567205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] PATH_INFO: `/v3/projects/05b2316a29804ca2ba2a37554933cacd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.568483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a009a-35aa-42bb-b7a3-ca9358b6e4d6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.568912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] RBAC: Authorizing `identity:get_project(project_id=05b2316a29804ca2ba2a37554933cacd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.571751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.578516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/projects/05b2316a29804ca2ba2a37554933cacd => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.578516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.582223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.608966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.609930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.610216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.610496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.611732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.613305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.619811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.620648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.716857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f08-838e-4ba8-8e2f-b47d8ded71ae None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.732178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e49-e382-46f0-ac93-d8ef8337def8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.761040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.762832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.763287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.764040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.766173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.767855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.769776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.770215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.770887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.771287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.771518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.771785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.773140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.774745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.776688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 66/132] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:03.777358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.824917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.851541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:03.884898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00385-83ec-40b5-a81b-e4d1dab2a2ad None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.906641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae9bb-4ef0-4c81-968c-8c2079e21075 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:03.921329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.922488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.922892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.923242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/users/bab5072763ec4572ae0e1127303e56ad/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.925605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, user_id=bab5072763ec4572ae0e1127303e56ad, role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.927177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:03.946404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 67/133] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:03 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/users/bab5072763ec4572ae0e1127303e56ad/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:03.948119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:03.961292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:03.962563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:03.963996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:03.964506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] PATH_INFO: `/v3/projects/05b2316a29804ca2ba2a37554933cacd/users/bab5072763ec4572ae0e1127303e56ad/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:03.971877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] RBAC: Authorizing `identity:create_grant(project_id=05b2316a29804ca2ba2a37554933cacd, user_id=bab5072763ec4572ae0e1127303e56ad, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:03.977045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.006432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 67/134] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:03 2022] PUT /identity/v3/projects/05b2316a29804ca2ba2a37554933cacd/users/bab5072763ec4572ae0e1127303e56ad/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:04.011888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:04.129032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464d89-55cd-4a72-bce0-cbeeb29f487e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.155201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:04.172607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.173742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.174189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.174614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.176085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:04.177592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d1e6-ae21-476a-a5b2-13be8624cf71 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.179409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 68/135] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:03 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:04.180886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563a59-23d3-4efb-9d34-d17c42a4b44a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.181162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563a59-23d3-4efb-9d34-d17c42a4b44a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.181412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563a59-23d3-4efb-9d34-d17c42a4b44a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.184117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 69/136] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:04.187913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563a59-23d3-4efb-9d34-d17c42a4b44a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:04.253751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb1de0-a98b-430c-a7d0-c0ab72082778 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.276981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:04.305263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.305947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.306372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.306661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.307712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, scope.project.id=51c51146274043308cc062f293d361dd, user.id=ea4dbe6463f944a081be741c6b19c377) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:04.308839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:04.310319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9220b1-93b4-4c75-b16f-b468b1a0c81b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.321664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 68/137] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:04 2022] GET /identity/v3/role_assignments?user.id=ea4dbe6463f944a081be741c6b19c377&scope.project.id=51c51146274043308cc062f293d361dd&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:04.323634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827fdd-c7c6-40d8-814b-ae5452e29432 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.324105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827fdd-c7c6-40d8-814b-ae5452e29432 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.324558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827fdd-c7c6-40d8-814b-ae5452e29432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.341451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563a59-23d3-4efb-9d34-d17c42a4b44a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.346979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c0827fdd-c7c6-40d8-814b-ae5452e29432 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:04.349872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c0827fdd-c7c6-40d8-814b-ae5452e29432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:04.424980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.425814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.426168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.426518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/users/2dee5b081bb1404bb27ed23c7dae2bf0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.432608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, user_id=2dee5b081bb1404bb27ed23c7dae2bf0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:04.434240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7076aab-43f8-44f1-bd95-4ab70051fad1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.442002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 69/138] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:04.460235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:04 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/users/2dee5b081bb1404bb27ed23c7dae2bf0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:04.486273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae419d6-2abd-4f39-b528-9d1668c207d4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.486609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae419d6-2abd-4f39-b528-9d1668c207d4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.486851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae419d6-2abd-4f39-b528-9d1668c207d4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.488394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 70/140] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:04.494779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.495082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.495404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.511410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae419d6-2abd-4f39-b528-9d1668c207d4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:04.515681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:04.517010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:04.571682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:04.652068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae419d6-2abd-4f39-b528-9d1668c207d4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.669775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:04.677416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 71/141] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:04.694988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bad73-4c27-486e-9637-128317daab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.696165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bad73-4c27-486e-9637-128317daab6b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.696626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bad73-4c27-486e-9637-128317daab6b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.697101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bad73-4c27-486e-9637-128317daab6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.698528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bad73-4c27-486e-9637-128317daab6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:04.700276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bad73-4c27-486e-9637-128317daab6b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.702234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 71/142] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:04.707843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:04.710401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bad73-4c27-486e-9637-128317daab6b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:04.839182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023974d-4d78-4124-af92-a7de106ac595 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.879371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.879371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.879371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.879371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.879777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:04.881710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:04.915100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 72/143] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:04 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:04.943252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bad73-4c27-486e-9637-128317daab6b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:04.984614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:04.985830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:04.986320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:04.986794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:04.998638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:05.006973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:05.007916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:05.008678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:05.011217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 72/144] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:05.017396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:05.047595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:05.166076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ee83-19bb-427b-9b13-7f06d647e583 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:05.213016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:05.213626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:05.213909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:05.214188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:05.215105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:05.215472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:05.217334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:05.230606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 73/145] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:05.236130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:05.301641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:05.375356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700d42f-a693-458c-a6fc-931e95670413 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:05.412564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:05.413459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:05.413743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:05.414028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:05.415244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:05.416749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:05.418390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 73/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:05 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:05.424345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:05.553264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:05.567962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c2fc-7f3a-4ed6-94f6-3c3aa7797b79 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:05.614754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:05.615449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:05.615733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:05.616008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:05.694839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:05.696491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:05.783735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:05.805551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 74/147] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:05.810924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:05.924231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf4b6-c569-44e6-9f15-25cd6c1d5de7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:05.933592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:05.961913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:05.962785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:05.963062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:05.963353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:05.964564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:05.966382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dbc9e-421c-4331-81e1-652ac74f1987 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:05.968442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 74/148] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:05 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:05.974599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:06.077293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13e82-207d-4533-9b54-f9c52ace33e4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:06.113139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:06.113808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:06.114099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:06.114367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:06.115218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=51c51146274043308cc062f293d361dd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:06.115557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:06.117019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cf364-2bb4-4ae0-8cf6-0cef4aadbff5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:06.123066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 75/149] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:05 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=51c51146274043308cc062f293d361dd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:07.065270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5565-bb1b-48d6-8c20-2421904e1fd8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.065793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5565-bb1b-48d6-8c20-2421904e1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.066117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5565-bb1b-48d6-8c20-2421904e1fd8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.067896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 75/150] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:07.073463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.073892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.074172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.092737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:07.094309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:07.136222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:07.164422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 76/151] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:07.187724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a5565-bb1b-48d6-8c20-2421904e1fd8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.344129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a5565-bb1b-48d6-8c20-2421904e1fd8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:07.386885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:07.387714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.388001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.388266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.402973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4c8bb3d7-3780-453c-a1ec-ae2817e8889d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:07.410855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:07.411835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:07.413538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 76/152] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:07.420541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.533343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5fabf-7fdc-479c-afd7-106c3e6b9223 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.533620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5fabf-7fdc-479c-afd7-106c3e6b9223 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.534049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5fabf-7fdc-479c-afd7-106c3e6b9223 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.535611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 77/153] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:07.541294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.541811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.542270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.565563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed32d-e5ed-40ef-9286-c9bb2a41c0b2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:07.586436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:07.587907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:07.626986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:07.627921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.628354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.628763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.629769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:07.630204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:07.631888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:07.650601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 77/154] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:07.656328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.673440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:07.727158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:07.729798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 78/155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:07.755879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.850685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6dc6a-2ab1-4131-b9fa-9e3d4fdbb58e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:07.912956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:07.913860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.914150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.914430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] PATH_INFO: `/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.917067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] RBAC: Authorizing `identity:get_user(user_id=2dee5b081bb1404bb27ed23c7dae2bf0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:07.918765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63b20-90eb-4034-bf67-7107536f0f88 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:07.922741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 78/156] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/users/2dee5b081bb1404bb27ed23c7dae2bf0 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:07.926089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a22-b8db-42a1-a37a-c5c50c5303e9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.927251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a22-b8db-42a1-a37a-c5c50c5303e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.928470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a22-b8db-42a1-a37a-c5c50c5303e9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.930439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3255-d6ea-4c28-a2b2-f09c8c45a83c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:07.933311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 79/157] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:07.934872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9f5d-97db-4bec-96d1-2b117305cc61 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.936152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9f5d-97db-4bec-96d1-2b117305cc61 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.936576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9f5d-97db-4bec-96d1-2b117305cc61 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.939453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 80/158] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:07.941236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c9f5d-97db-4bec-96d1-2b117305cc61 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.996022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:07.998158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.999576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.000017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.021676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b541b8e1-8b38-41a1-a495-ee63c032314c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:08.033763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:08.034924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:08.035932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:08.039672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 79/159] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:08.045897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596365-ebdf-42b1-805a-823061cc3bf5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.046354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596365-ebdf-42b1-805a-823061cc3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.046780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596365-ebdf-42b1-805a-823061cc3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.065133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-97596365-ebdf-42b1-805a-823061cc3bf5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:08.066605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-97596365-ebdf-42b1-805a-823061cc3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:08.094787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.153065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c9f5d-97db-4bec-96d1-2b117305cc61 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.156786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.174599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:08.175997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.176285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.176556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.205360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:08.206552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:08.221428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.222091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.222462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.222741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.348909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 81/161] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:08.349773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.351142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:08.360738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:08.477635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:08.478434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.481543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.530702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.555744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb71f96-9d23-4d63-95b7-caca9c21c486 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.620124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.620808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.621089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.621367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.622126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:08.622433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:08.625479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:08.640437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 82/163] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:08.642417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.662700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb051a9-7d14-4b1e-a123-d3b504e90853 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.706702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.707551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.707891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.708166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.719039 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:08.726954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:08.727880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:08.728679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 82/164] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:08.729321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.771062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073382-9d9a-4791-837b-78f03e399356 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.796492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.810554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.811731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.812154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.812566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.824570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:08.833832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:08.835152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:08.836168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:08.836783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6862b8-eb57-409f-9433-c67eeb187588 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.838779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 83/165] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:08.839947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.852908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:08.871599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.872486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.872878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.873058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.874235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:08.875786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb688b-2f2e-4ac7-bd42-807f1d17242f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:08.877481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 83/166] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:08.878720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339bb2-ddda-431f-adf7-eacb4da20c92 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.879003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339bb2-ddda-431f-adf7-eacb4da20c92 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.879275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339bb2-ddda-431f-adf7-eacb4da20c92 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.880545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 84/167] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:08.881241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339bb2-ddda-431f-adf7-eacb4da20c92 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:08.956615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3aebf-4696-442a-909e-6da2d9d753eb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.993165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:08.993348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339bb2-ddda-431f-adf7-eacb4da20c92 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:08.994622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:08.995154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:08.995731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:08.997290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:08.999176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.001292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.002338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.034247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.041561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.042577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.043064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.043627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.044607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:09.045196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.047040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.056891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.058112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.106728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.137915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea6c8-b220-414a-a85c-a1f49f57ab78 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.177502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.178717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.179463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.180444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.181626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:09.182124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.182698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b243f6-9e22-4c3f-a9b1-ab8b41435f46 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.184531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722c002-3be5-40bf-8939-17d5cc132e93 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.195780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 85/170] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.198041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.198552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.199487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.219157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:09.220365 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:09.221359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.222024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.222395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.222663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.223532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=51c51146274043308cc062f293d361dd, user.id=2dee5b081bb1404bb27ed23c7dae2bf0) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:09.223844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.225300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.231382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 86/171] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/role_assignments?user.id=2dee5b081bb1404bb27ed23c7dae2bf0&scope.project.id=51c51146274043308cc062f293d361dd&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.232021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.296176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 86/172] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:09.297565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.311780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.359753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759446b4-d0f3-4411-b4cf-3233c9dabc42 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.376471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.399312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.399986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.400092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.402956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.417252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363ba3-42ac-4c58-b698-639bb8b3004b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.456617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.457509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.457791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.458055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] PATH_INFO: `/v3/users/ea4dbe6463f944a081be741c6b19c377` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.459263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4dbe6463f944a081be741c6b19c377)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.460911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.462802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 87/173] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/users/ea4dbe6463f944a081be741c6b19c377 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.463352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.474761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.476272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe261a0-83d2-4250-ae2e-07214dca40d4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.529834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.560555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b9e1-d6b3-469b-b982-b6682edabce1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.570873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 87/174] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:09.572354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329afe9-8db8-4c33-83aa-d3c9f06f0d8c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.572639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329afe9-8db8-4c33-83aa-d3c9f06f0d8c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.572914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329afe9-8db8-4c33-83aa-d3c9f06f0d8c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.574178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 88/175] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:09.575350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc76c-b5c5-415a-a1d2-ddabda6b8611 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.575637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc76c-b5c5-415a-a1d2-ddabda6b8611 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.575914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc76c-b5c5-415a-a1d2-ddabda6b8611 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.577292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 89/176] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:09.578152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dc76c-b5c5-415a-a1d2-ddabda6b8611 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.602091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.602977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.603267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.603565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] PATH_INFO: `/v3/users/bab5072763ec4572ae0e1127303e56ad` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.604790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=bab5072763ec4572ae0e1127303e56ad)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.606248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.607971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 88/177] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/users/bab5072763ec4572ae0e1127303e56ad => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.608718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.615328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.680266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dc76c-b5c5-415a-a1d2-ddabda6b8611 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.704661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204415cf-d19b-42f0-a784-19f9a8b16bc2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.716461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.717289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.717563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.717819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.728814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:09.736612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:09.736749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:09.737610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:09.738394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:09.738984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.738984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.739101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 90/178] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:09.739101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.741228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.743302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.744826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7976c9-7c9e-4bb7-a22a-51a121f62d31 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.746588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 89/179] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.747787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cdbb-a4a7-4484-80e1-3b76b4066974 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.748508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cdbb-a4a7-4484-80e1-3b76b4066974 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.748791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cdbb-a4a7-4484-80e1-3b76b4066974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.757641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.766271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d6f0cdbb-a4a7-4484-80e1-3b76b4066974 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:09.767474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d6f0cdbb-a4a7-4484-80e1-3b76b4066974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:09.831183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 90/180] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:09.832406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945374-f668-4351-9a85-10f775c95cdd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.832691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945374-f668-4351-9a85-10f775c95cdd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.832966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945374-f668-4351-9a85-10f775c95cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.837834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.845220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4998d-c6c6-4840-ae1b-e748588e3778 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:09.852039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-42945374-f668-4351-9a85-10f775c95cdd None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:09.853428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-42945374-f668-4351-9a85-10f775c95cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:09.878427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:09.879308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:09.879698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:09.879973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] PATH_INFO: `/v3/projects/05b2316a29804ca2ba2a37554933cacd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:09.881207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=05b2316a29804ca2ba2a37554933cacd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:09.882698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:09.884419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 91/181] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/projects/05b2316a29804ca2ba2a37554933cacd => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:09.888146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.920616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 91/182] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:09.921305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42945374-f668-4351-9a85-10f775c95cdd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:09.973683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:09.988365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975dcc5-f25b-48c6-86c2-b653e6233fa0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.020158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.020802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.021083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.021350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.028860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42945374-f668-4351-9a85-10f775c95cdd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.057219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.062708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.063388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.063700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.063974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.064715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:10.065024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.066432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.074423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 92/183] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.075184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.093443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.094875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.177203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d703b-9971-4e25-806b-bfb193a3e6ee None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.182331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.197718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 92/184] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:10.198619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.212358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.213224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.213532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.213802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/users/ea4dbe6463f944a081be741c6b19c377/roles/f057ca8dd524469a8d73b0e16829b698` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.215813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, user_id=ea4dbe6463f944a081be741c6b19c377, role_id=f057ca8dd524469a8d73b0e16829b698)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.217733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.231036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:10 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/users/ea4dbe6463f944a081be741c6b19c377/roles/f057ca8dd524469a8d73b0e16829b698 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:10.231637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.298903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.315625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d7fa-c943-43f3-88ed-af02a6181e04 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.353994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8621c1-9d1d-42bf-a5d8-57646a22aaeb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.355192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.356073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.356360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.356633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.368443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:10.377042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:10.378014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:10.378910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 93/186] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:10.379608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.403464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.404178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.404462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.404731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.405568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=05b2316a29804ca2ba2a37554933cacd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:10.405873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.407320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.413937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 94/187] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=05b2316a29804ca2ba2a37554933cacd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.414815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.435729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.500347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56edaab-cc4e-41d8-a8fe-ee41e2904dfb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.540811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.541992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.542474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.542949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.543078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a128-e951-4f6b-99bc-e687e0630698 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.544797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.546710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.548694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 94/188] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.554262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.567010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.591735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.592637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.592915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.593190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.611725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.613575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.616288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 95/189] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.620081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.683652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851aa-a052-44bb-8573-421d0f4d718e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.707789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.734365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.735260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.735636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.735917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.737134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.738643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.740592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 95/190] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.742067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255d273-3f47-4931-ae3a-8fcc08f4c45e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.745925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.779464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.780146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.780439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.780708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.781998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:10.781998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.783142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.796170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 96/191] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:10.796170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.837545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:10.854834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc533c-d72a-43a5-9e6f-25d157e7eb46 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.890531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.891215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.891529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.891815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.892561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:10.894019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:10.898949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db3ccc-8c1f-444a-b563-853706d86c7b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:10.916596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 96/192] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:10 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:10.917401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:10.940828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:10.941505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:10.941789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:10.942187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:10.969035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.019878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.021696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.042578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d4bb-e2e4-444f-aab9-0862fc2b9154 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.063387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.083398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.084550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.085040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.085554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.086667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=51c51146274043308cc062f293d361dd, user.id=bab5072763ec4572ae0e1127303e56ad) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:11.087147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.089033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.095959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 97/193] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/role_assignments?user.id=bab5072763ec4572ae0e1127303e56ad&scope.project.id=51c51146274043308cc062f293d361dd&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:11.097117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:11.140337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 97/194] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:11.147583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:11.230028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ed2b-dadd-4288-9a8e-1533035ad591 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.231988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.271791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.273007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.273433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.273849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.275327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.277033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.279296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 98/195] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:11.283981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7814c-8944-45e0-96fa-07c8e0e72ee6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.285486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:11.341962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.343472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.343700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.343978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.345311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.347706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.349925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 98/196] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:11.355237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:11.375482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.443204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b286caa-df6d-4011-bb30-8f8fae51c938 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.485523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.486691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.486981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.487263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.498054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d732-8313-4faf-a941-a96a5a686afe None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.549238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.549443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.549917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.550196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.550472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.551317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c9df46776902484da599b0c6390c4358) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:11.551653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.553144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.559524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 99/197] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/role_assignments?user.id=c9df46776902484da599b0c6390c4358&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:11.586869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.588444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.699997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 99/198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:11.708536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:11.809668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:11.849128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7110-8dd9-49e3-a7ae-ecfeef5c3586 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:11.896660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:11.897521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:11.897798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:11.898065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:11.904106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:11.905594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287015-b789-4b02-ba64-fd92768472ca None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:11.907579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 100/199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:11.913731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:12.006471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:12.040633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a58a-e38c-4ec7-8cf5-857244fd54e3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:12.089145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:12.089861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:12.090139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:12.090455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:12.091747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c9df46776902484da599b0c6390c4358) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:12.092053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:12.093538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10750170-b11d-4c30-b39a-50a14cdcb8fd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:12.104531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 100/200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:11 2022] GET /identity/v3/role_assignments?user.id=c9df46776902484da599b0c6390c4358&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:12.528039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4bfb-9be5-4c47-ba39-9352242ab2ab None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:12.528567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4bfb-9be5-4c47-ba39-9352242ab2ab None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:12.528567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4bfb-9be5-4c47-ba39-9352242ab2ab None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:12.530024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 101/201] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:12.544960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:12.545382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:12.545552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:12.567306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:12.568542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:12.640314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 101/202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:12.678966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d4bfb-9be5-4c47-ba39-9352242ab2ab None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:12.852356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d4bfb-9be5-4c47-ba39-9352242ab2ab None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:12.907997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:12.909154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:12.909577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:12.910009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:12.922403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:12.932358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:12.944133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:12.945189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:12.946183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:12.948609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 102/203] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:12.954478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:13.055958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:13.105793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ece6-19cb-4f52-895a-a62faa8f07b1 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:13.157458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:13.158143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.158425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.158756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:13.159542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:13.159849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:13.161257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:13.169526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 102/204] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:13.175386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:13.327037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f5df1-f940-4d83-829e-0800ac228a5d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:13.376237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:13.377495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.377976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.378459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] PATH_INFO: `/v3/users/ea4dbe6463f944a081be741c6b19c377` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:13.384059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4dbe6463f944a081be741c6b19c377)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:13.385761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:13.387994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 103/205] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:13 2022] GET /identity/v3/users/ea4dbe6463f944a081be741c6b19c377 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:13.393265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:13.550030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661afa6-28e8-469f-be73-c685c889cd79 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:13.590530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:13.604018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:13.604691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.604973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.605248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:13.694737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:13.696253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d4a37-931c-4198-87be-2337f3e7f468 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:13.810901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 103/206] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:13.816624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:13.840674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32fd85-041c-4428-b04f-585fe5aa916a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.841744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32fd85-041c-4428-b04f-585fe5aa916a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.842234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32fd85-041c-4428-b04f-585fe5aa916a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:13.844167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 104/207] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:13.849378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331c0b-4fc2-4d03-8e2f-594d87359766 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.849663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331c0b-4fc2-4d03-8e2f-594d87359766 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.849937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331c0b-4fc2-4d03-8e2f-594d87359766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:13.880108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-89331c0b-4fc2-4d03-8e2f-594d87359766 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:13.881303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-89331c0b-4fc2-4d03-8e2f-594d87359766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:13.916810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:13.926831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:13.971850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492534-08e5-440d-b173-22dc6886b937 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:13.996512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 105/208] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:13.998059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d939c0-6eff-465d-9aa9-c045391a981d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:13.998347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d939c0-6eff-465d-9aa9-c045391a981d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:13.998683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d939c0-6eff-465d-9aa9-c045391a981d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.000293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 106/209] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:14.005543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.005825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.006196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.024087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:14.024938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.025329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:14.025821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.026096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.026366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.027854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.029396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.031125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 104/210] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:13 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.038812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.114903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 107/211] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:14.124610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.182894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc3ad-9b8d-4891-8c2b-e3674b20f2c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.217695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.218582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.218858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.219129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.220009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, scope.project.id=51c51146274043308cc062f293d361dd, user.id=ea4dbe6463f944a081be741c6b19c377) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:14.220325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.221754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.223661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.226428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.235494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 105/212] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/role_assignments?user.id=ea4dbe6463f944a081be741c6b19c377&scope.project.id=51c51146274043308cc062f293d361dd&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.235494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.255327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a7c17-71fa-4645-aea4-b9ba7d4399a9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.305078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.306674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.306975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.327535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-79d04bf1-973e-46da-859a-c8e14e0cec81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:14.340177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:14.341549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:14.342332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:14.342933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 108/213] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:14.344285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7091a4-1ac5-44ec-829d-b80082b89d6e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.347378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7091a4-1ac5-44ec-829d-b80082b89d6e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.347378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7091a4-1ac5-44ec-829d-b80082b89d6e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.350754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 109/214] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:14.351667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7091a4-1ac5-44ec-829d-b80082b89d6e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.368372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce90f3-be39-4a51-8aa8-80dbca28bc76 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.415275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.416669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.417300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.417779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.432524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3baf52c3-731c-4bb1-bb9d-e6de4caffab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:14.440574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:14.441451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:14.442224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:14.445021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 106/215] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:14.446454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b11d-5640-42f0-be06-c774a945412b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.446949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b11d-5640-42f0-be06-c774a945412b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.447437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b11d-5640-42f0-be06-c774a945412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.465838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e4f8b11d-5640-42f0-be06-c774a945412b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:14.468167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e4f8b11d-5640-42f0-be06-c774a945412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:14.482137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7091a4-1ac5-44ec-829d-b80082b89d6e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.519663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.520344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.520630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.520907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.521665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:14.521975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.523443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.529241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.532085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 110/216] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.532887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.543029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.548361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 107/217] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:14.549735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736941b-ea63-4336-85c7-efafd8dfb23a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.550019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736941b-ea63-4336-85c7-efafd8dfb23a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.550290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736941b-ea63-4336-85c7-efafd8dfb23a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.551563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 108/218] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:14.552263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736941b-ea63-4336-85c7-efafd8dfb23a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.641250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543eac4-6f07-4ede-8c5b-0157e8e1679a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.654954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736941b-ea63-4336-85c7-efafd8dfb23a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.675491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.676176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.676452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.676723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.677487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:14.677790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.679192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f8a29-1714-494f-b3d0-fb758441350a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.686975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.687750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 111/219] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.688932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.689215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.689490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.691541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.691955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.692251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.693505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.694976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.700960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 109/220] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.700960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.706998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:14.708572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:14.755620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.768827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.773685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 112/221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:14.776204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.800164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc41-1088-4cf2-a5cb-4530b17d6fb9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.833984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.834866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.835061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.835329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.836528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.837980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.839839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 110/222] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.840393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.877094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b523-4d18-45fe-aa51-7ff51afb969f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.911181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.912104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.912376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.912984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] PATH_INFO: `/v3/users/c6134e16daa441b7869a897e6d6a611a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.925839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] RBAC: Authorizing `identity:get_user(user_id=c6134e16daa441b7869a897e6d6a611a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.927347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.929084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 113/223] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/users/c6134e16daa441b7869a897e6d6a611a => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.929839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.937568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f8e6c-3ddc-42b4-8af7-19378284a3b5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:14.960930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:14.972123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:14.972996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:14.973276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:14.973551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:14.974767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:14.976256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:14.978188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 111/224] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:14.978934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:14.987657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.029803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722478-8b26-4839-8c7b-6d714ea867ec None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.063597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.064452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.065045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.065045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.075052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:15.076732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff207a6d-a3aa-41f2-a7a7-1f9c531f583b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:15.083490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:15.084376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 114/225] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:15.085438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.117084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.117762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.118042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.118324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.119033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.120521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.147764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 112/226] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:14 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:15.148561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.192529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03836-5e1f-4dec-ad01-fe80d56de4c0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.204903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.216332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.234882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.235595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.235878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.236152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.266430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72ac6b-e20b-4db7-af32-cd8f5e7e65f6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.301512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.302339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.302614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.302881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c9df46776902484da599b0c6390c4358/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.305094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, user_id=c9df46776902484da599b0c6390c4358, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.306559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.316553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.318545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.323400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 113/227] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:15 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c9df46776902484da599b0c6390c4358/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:15.324398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.468882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 115/228] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:15.474405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafee8-7e10-4bf5-9bfe-76e9e5f0ee20 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.474805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.493089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.498349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.531555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.532247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.532521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.532790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.533663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:15.533970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.536191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.546214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 114/229] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:15.551919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.604997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898918c1-b6ab-4404-a694-4ea95bba3a74 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.651145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.654658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.654658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.654658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.657034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.658540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.661632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 116/230] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:15.669377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.695715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c697e5-c257-4265-8734-2ccf7d023cee None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.735504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.735504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.735504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.735504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.735907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.736859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.738713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 115/231] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:15.744100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:15.787970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.839455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:15.857147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea30fd-b131-4941-a0ce-923bae8f27ad None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.873935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bba8e1-ab2d-481d-ad53-17a2475188b4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:15.914467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:15.916954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:15.917234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:15.917504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:15.931933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:15.931933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:15.931933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 116/232] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:15.947508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:16.040653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:16.041701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:16.042178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:16.042668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:16.043816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c6134e16daa441b7869a897e6d6a611a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:16.044330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:16.046057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79399b-d905-452a-8055-f5ff51ced6c2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:16.059599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 117/233] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:15 2022] GET /identity/v3/role_assignments?user.id=c6134e16daa441b7869a897e6d6a611a&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=0923251e0e694650be6c27d7aafe4826 => generated 259 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:16.247806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6389-ee6e-4dde-bf49-e246a80fc351 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:16.258865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:16.309444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:16.310429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:16.310712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:16.310989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c9df46776902484da599b0c6390c4358/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:16.313571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, user_id=c9df46776902484da599b0c6390c4358, role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:16.315045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19e877-0369-4bc4-b41e-a5d2fdbe75b6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:16.339329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:15 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c9df46776902484da599b0c6390c4358/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:26:17.783820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb91bb-36f1-4282-afe3-d667543f8146 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:17.784367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb91bb-36f1-4282-afe3-d667543f8146 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:17.784367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb91bb-36f1-4282-afe3-d667543f8146 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:17.785766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:17.791205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769a1-e9a2-45d1-8863-ab44eaf57aa3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:17.791630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769a1-e9a2-45d1-8863-ab44eaf57aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:17.791793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769a1-e9a2-45d1-8863-ab44eaf57aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:17.817074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-83f769a1-e9a2-45d1-8863-ab44eaf57aa3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:17.818295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-83f769a1-e9a2-45d1-8863-ab44eaf57aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:17.900216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 118/236] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:17.923654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb91bb-36f1-4282-afe3-d667543f8146 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:17.983069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340799-6121-4163-a0ca-b6666764836f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:17.983409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340799-6121-4163-a0ca-b6666764836f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:17.983657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340799-6121-4163-a0ca-b6666764836f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:17.985050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 119/237] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:17.990380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b651268-4293-4f3f-9a48-ffa1f411b744 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:17.990685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b651268-4293-4f3f-9a48-ffa1f411b744 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:17.990942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b651268-4293-4f3f-9a48-ffa1f411b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.008609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4b651268-4293-4f3f-9a48-ffa1f411b744 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:18.009796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b651268-4293-4f3f-9a48-ffa1f411b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:18.047793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb91bb-36f1-4282-afe3-d667543f8146 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.087448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:18.087448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbfec-3831-4770-958c-ae08dfb34090 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.087448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbfec-3831-4770-958c-ae08dfb34090 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.087448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbfec-3831-4770-958c-ae08dfb34090 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.087448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 121/239] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:18.092616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.092906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.093185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.107416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.107416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.107416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.107416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.125249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:18.126512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:18.127882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:18.138693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:18.139637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:18.140427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:18.141018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 119/240] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:18.141780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.153004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.161494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.204956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:18.206183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.281088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7a49-1ec0-4ca3-9586-10a0eb358d24 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.316406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.317585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.318201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.318670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.320153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:18.321853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ba239-cbe6-4093-b867-7c0f19472346 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.322099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:18.324013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 120/242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:18.329496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.361819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.362872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.363426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.363929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.364864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:18.365357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:18.366827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:18.380350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 123/243] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:18.380350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.401926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.435727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.468298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927099c-9cc4-403c-9843-e3f21744be98 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.499213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373389-2b8a-48d2-a641-1719406816c2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.516455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.517998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.518486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.518961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.534917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:18.538112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.538916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.539297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.539694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.540569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:18.542161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc3de8-301d-43ee-9254-d9d766041a06 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:18.544661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:18.545753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:18.546751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:18.553676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 121/244] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:18.554448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.575436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 124/245] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:18 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:18.575436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a80a-26cb-4e2b-8b43-fa2cbc42a2cc None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.575436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a80a-26cb-4e2b-8b43-fa2cbc42a2cc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.575436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a80a-26cb-4e2b-8b43-fa2cbc42a2cc None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.575436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 125/246] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:18.577200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2a80a-26cb-4e2b-8b43-fa2cbc42a2cc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.674933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc506f-f616-4925-aef1-f631b53421ff None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.695233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.714797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.715829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.716496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.716770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.718055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:18.719807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e373537-bfd4-475e-8696-e82f6e130e4a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:18.721837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 122/247] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:18.724185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.724638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.725086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.736339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2a80a-26cb-4e2b-8b43-fa2cbc42a2cc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.740535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:18.747928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:18.749455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:18.781355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.782049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.782336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.782604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.783398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:18.783789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:18.785197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:18.795515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 126/248] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:18.798872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.842218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 123/249] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:18.843301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:18.922752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f487b-57c3-4efc-8c44-9fcc1d326eaa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.967654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b52ca-cefe-4955-ae7a-9459df0506bd None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:18.972809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:18.973688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:18.974106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:18.974515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:18.992500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.006008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.007553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.007553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.007553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] PATH_INFO: `/v3/users/ed5edef48c884d5aa5142aa4128a3e32` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.011587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.024972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] RBAC: Authorizing `identity:get_user(user_id=ed5edef48c884d5aa5142aa4128a3e32)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.026513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.029400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 124/250] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/users/ed5edef48c884d5aa5142aa4128a3e32 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.030254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.072588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.074153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.150946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfa45-51e9-4b85-8e3b-0e1e26af19cb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.186392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.187202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.187512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.187787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.198208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3f8e173d-fa18-4777-a86e-eea92cc866d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:19.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:19.207041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:19.207876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 125/251] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:19.208524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 127/252] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:19.208939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffac14-d440-46dc-ad8a-dca6557e6f02 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.209838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffac14-d440-46dc-ad8a-dca6557e6f02 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.209838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffac14-d440-46dc-ad8a-dca6557e6f02 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.211031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 126/253] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:19.211638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.213535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffac14-d440-46dc-ad8a-dca6557e6f02 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.256128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.292256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.336644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3c7e-f434-42b8-8b92-370586c2c90a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.352390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffac14-d440-46dc-ad8a-dca6557e6f02 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.381266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.382151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.382435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.383000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.393906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.394588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.394872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.395155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.396428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:19.396740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.398882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.410756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 127/254] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.412177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.461745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.463261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.500313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.520984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94a9bc-4c21-4956-a4c1-0193f16dbedf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.555300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.556468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.556754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.557105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.558826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.559467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.561472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ef51-a1e2-4088-addd-fe874d4ec47c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.563829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 128/255] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.565092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.565380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.565654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.586306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:19.587518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:19.587980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 128/256] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:19.589120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.674651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 129/257] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:19.676182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.699668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de3d5-26a3-4784-b8ff-937c5cb34178 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.736504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.737957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.738477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.738941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] PATH_INFO: `/v3/users/c6134e16daa441b7869a897e6d6a611a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.740516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] RBAC: Authorizing `identity:get_user(user_id=c6134e16daa441b7869a897e6d6a611a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.742433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.744629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 129/258] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/users/c6134e16daa441b7869a897e6d6a611a => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.745756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.750359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.797290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f892-5838-4ca7-97c4-9fd7d3b7063e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.814719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:19.839800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.840533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.841494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.841775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.842611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c9df46776902484da599b0c6390c4358) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:19.843138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.844845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.856680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 130/259] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/role_assignments?user.id=c9df46776902484da599b0c6390c4358&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.856680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.865454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4e87-d8a3-46a5-8c92-cdeed9d1ef90 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:19.914848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:19.915980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:19.916362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:19.916823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:19.918263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:19.919939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:19.922238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:19.923255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:19.973753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1362f2-dfce-439c-99a2-639163d59644 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.005514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.014495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.015748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.016214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.016659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.029367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:20.038966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:20.040034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:20.040823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:20.041418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73cb9-4872-4bfb-84d2-aa373d1f7e70 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.043474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:20.044584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.083317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.083955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.084236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.084516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.085795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.093500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.093701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.096278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 131/262] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:19 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:20.097187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.165101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99312-2d9c-4c6e-8768-4dcaa1cc4962 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.201175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.202227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.202771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.203248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.204315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=ed5edef48c884d5aa5142aa4128a3e32) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:20.204833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.206689 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.213273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 132/263] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/role_assignments?user.id=ed5edef48c884d5aa5142aa4128a3e32&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:20.214273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.214939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bff3-e05f-4101-bdf0-8f65a30ebe8e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.254989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.255579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.255862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.256138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.256971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:20.257270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.258778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.267876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 132/264] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:20.273990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.277468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.330988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce8023-fe52-4082-9cdb-88782ede8a21 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.347721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.371010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.372296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.372901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.373375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c6134e16daa441b7869a897e6d6a611a/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.375866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, user_id=c6134e16daa441b7869a897e6d6a611a, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.377710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.386249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5d698-9f08-4cee-9762-743e6e14b8b6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.400554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 133/265] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:20 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/c6134e16daa441b7869a897e6d6a611a/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:20.456137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.457061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.457343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.457619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] PATH_INFO: `/v3/users/c9df46776902484da599b0c6390c4358` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.464425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] RBAC: Authorizing `identity:get_user(user_id=c9df46776902484da599b0c6390c4358)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.467094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.468826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 133/266] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/users/c9df46776902484da599b0c6390c4358 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:20.475242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.598868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1089f-6316-451a-bd68-2defcee020a8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.636282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.637396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.637916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.638438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.676439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.711430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.713312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.815387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 134/267] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:20.821270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:20.896368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:20.929194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de050-5d9e-46b6-a866-919c059f053d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:20.963840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:20.965171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:20.965688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:20.966559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:20.968016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:20.969662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee84ebc-039a-48df-9266-96f948115d27 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:20.971627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 134/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:20.980550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.051051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76b52-9f93-468e-a8eb-6008a6e218ad None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.051717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76b52-9f93-468e-a8eb-6008a6e218ad None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.052185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76b52-9f93-468e-a8eb-6008a6e218ad None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.054044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 135/269] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:21.059052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.059840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.060372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.079481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:21.081286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:21.087682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.156857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 136/270] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:21.180428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.192613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8f0c-f4be-477c-ac4c-5fdcad49a8ad None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.258333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.294031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5df182-caaf-476b-b9e6-f69121048804 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.310897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.311623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.311900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.312172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.313011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c9df46776902484da599b0c6390c4358) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:21.313318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:21.316311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2038dfb-f535-47ef-a808-033717125510 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:21.328664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 135/271] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:20 2022] GET /identity/v3/role_assignments?user.id=c9df46776902484da599b0c6390c4358&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:21.339630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e1c0b-445d-4418-af72-ed6c372afc01 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.339962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e1c0b-445d-4418-af72-ed6c372afc01 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.340180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e1c0b-445d-4418-af72-ed6c372afc01 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.342021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 136/272] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:21.347774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.348073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.348331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.371836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.372748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.373025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.373294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.382088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:21.383316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:21.401605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:21.415574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:21.416516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:21.417299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:21.422382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 137/273] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:21.427697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.526497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 137/274] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:21.563576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.595403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad254-15c0-4fd5-b86c-8c4fa44394c9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.631079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.642268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.643370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.643663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.643947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.644712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:21.645029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:21.646420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:21.653859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.659723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 138/275] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:21.666051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.715278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae282f-6b51-4928-b747-cc00aa99d4f7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.755914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.756727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.757006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.757277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.758433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:21.759958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:21.761869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 138/276] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:21.767681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.775014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702088-39b7-4516-a832-4390dd9dcb69 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.809229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.810154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.810439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.810717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] PATH_INFO: `/v3/users/db71648b43a84360a70ba1507268f551` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.825268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] RBAC: Authorizing `identity:get_user(user_id=db71648b43a84360a70ba1507268f551)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:21.826859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:21.828638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 139/277] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:21 2022] GET /identity/v3/users/db71648b43a84360a70ba1507268f551 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:21.834312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:21.876896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cc89-1736-4c4d-8649-a82dab2a08e1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.892713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.901198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:21.912303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.913030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.913313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.913586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:21.914303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:21.915816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac55f5-5914-40b2-b59f-06baf0290e20 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:21.937066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 139/278] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:21 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:21.955693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdf9d7-83ee-4428-a4cf-25fd6fa47f4f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:21.998058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:21.998586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:21.998877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:21.999153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:22.000041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, user.id=db71648b43a84360a70ba1507268f551, scope.system=all) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:22.000357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:22.002112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be51e20-16dc-443c-a58f-b3faebe37909 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:22.008830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 140/279] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 23 13:26:21 2022] GET /identity/v3/role_assignments?user.id=db71648b43a84360a70ba1507268f551&scope.system=all&role.id=0923251e0e694650be6c27d7aafe4826 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:22.778791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80174-9bcc-422f-8e11-b94f3f4536bb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:22.779364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80174-9bcc-422f-8e11-b94f3f4536bb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:22.779474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80174-9bcc-422f-8e11-b94f3f4536bb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:22.780847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 140/280] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:22.786299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b262ce-8b8e-431b-9cd0-b22e6904de71 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:22.786585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b262ce-8b8e-431b-9cd0-b22e6904de71 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:22.786860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b262ce-8b8e-431b-9cd0-b22e6904de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:22.807367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f0b262ce-8b8e-431b-9cd0-b22e6904de71 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:22.808549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f0b262ce-8b8e-431b-9cd0-b22e6904de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:22.895418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 141/281] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:22.911436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55909-4a64-48ea-a1fc-498babf02049 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:22.911724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55909-4a64-48ea-a1fc-498babf02049 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:22.912000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55909-4a64-48ea-a1fc-498babf02049 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:22.914679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 141/282] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:22.918992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:22.919277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:22.919612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:22.930316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55909-4a64-48ea-a1fc-498babf02049 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:22.954931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:22.956148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:23.029754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:23.089127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 142/283] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:23.111887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55909-4a64-48ea-a1fc-498babf02049 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.114966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.176954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.177808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.178094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.178369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.200325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:23.218885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:23.219842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:23.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:23.222891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 142/284] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:23.226867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.282171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120860b-8fc4-4e47-8da0-d011737c2635 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.307930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:23.326724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.327624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.327901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.328173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.347717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:23.364979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:23.365951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:23.366735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 143/285] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:23.372934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e06f2-a9ff-48fd-b5a8-a60ddaaecadd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.380981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.408263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.408948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.409228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.409501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.410246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:23.410552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:23.411995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:23.420947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 143/286] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:23.435791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:23.436613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.544867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae61e0-b7b8-4e8d-9226-b5db97e75723 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.609531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecd0b-2c03-4ef0-9c58-02941f125822 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.611196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:23.613918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.614607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.614861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.615132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.615918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:23.616221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:23.619704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:23.635392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 144/287] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:23.644577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.681545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.682500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.682779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.683093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] PATH_INFO: `/v3/users/ed5edef48c884d5aa5142aa4128a3e32` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.685961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] RBAC: Authorizing `identity:get_user(user_id=ed5edef48c884d5aa5142aa4128a3e32)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:23.688715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:23.690534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 144/288] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/users/ed5edef48c884d5aa5142aa4128a3e32 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:23.696345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.824998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:23.839091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231fdc-ef7b-40db-b990-57694c46aaf9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.875213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f8b9-761c-4e20-9114-41c6d421d030 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:23.897464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.898355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.898636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.898909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] PATH_INFO: `/v3/users/c6134e16daa441b7869a897e6d6a611a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.900911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] RBAC: Authorizing `identity:get_user(user_id=c6134e16daa441b7869a897e6d6a611a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:23.902370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:23.905364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 145/289] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/users/c6134e16daa441b7869a897e6d6a611a => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:23.911499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:23.944395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:23.945523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:23.945970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:23.946398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:23.948738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:23.950367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:23.952345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 145/290] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:23.957927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.020465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.100756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48067f-c078-4df6-9f5f-2635a231cbbe None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.137456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e665a8-e0dd-45e3-a654-78ea1638bb62 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.166657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.167436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.167720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.167993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.199862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.200838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.201121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.201399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/ed5edef48c884d5aa5142aa4128a3e32/roles/f057ca8dd524469a8d73b0e16829b698` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.204515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, user_id=ed5edef48c884d5aa5142aa4128a3e32, role_id=f057ca8dd524469a8d73b0e16829b698)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:24.205986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243b4b5-f304-4f1a-9695-412911eab6ff None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:24.217681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.228998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:23 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/users/ed5edef48c884d5aa5142aa4128a3e32/roles/f057ca8dd524469a8d73b0e16829b698 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:26:24.284653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:24.286190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a343d-2a05-475c-a742-4a052e2f4e42 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:24.323207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ab99-3efa-44ad-aff0-e35fb5e759fe None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.323544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ab99-3efa-44ad-aff0-e35fb5e759fe None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.323860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ab99-3efa-44ad-aff0-e35fb5e759fe None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.325783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 147/292] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:24.332310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3241-341b-4234-a2a8-d6f7dd2a0d19 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.332598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3241-341b-4234-a2a8-d6f7dd2a0d19 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.332878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3241-341b-4234-a2a8-d6f7dd2a0d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.367598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-eb9a3241-341b-4234-a2a8-d6f7dd2a0d19 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:24.368796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-eb9a3241-341b-4234-a2a8-d6f7dd2a0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:24.406690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 146/293] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:24.408699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5202133-2270-4a85-a46f-af38f2544168 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.409218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5202133-2270-4a85-a46f-af38f2544168 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.409715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5202133-2270-4a85-a46f-af38f2544168 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.411473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 147/294] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:24.412593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5202133-2270-4a85-a46f-af38f2544168 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.475356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 148/295] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:24.475356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.475356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.475356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.490062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.490537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:24.492438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:24.521817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.551322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5202133-2270-4a85-a46f-af38f2544168 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.577448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 149/296] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:24.578359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.597544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.599113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.599770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.600049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.601668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:24.603126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a764-d696-4b2b-bbfd-eb4bf851eecf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:24.604893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 148/297] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:24.606096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b79b-ef73-40c6-96ba-448d1354c5d2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.606384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b79b-ef73-40c6-96ba-448d1354c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.606704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b79b-ef73-40c6-96ba-448d1354c5d2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.608129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 149/298] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:24.610357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b79b-ef73-40c6-96ba-448d1354c5d2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.686720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385a3f-6b9c-4cd4-a622-82efba564552 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.710319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b79b-ef73-40c6-96ba-448d1354c5d2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.720647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.721503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.721781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.722050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.732970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:24.739471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:24.740823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:24.741987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:24.743031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 150/299] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:24.748379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.750054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.750862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.751156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.751439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.762332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:24.768373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-923391b8-2082-411f-866c-fba13e0d4032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:24.770112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:24.770953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 150/300] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:24.777137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.778008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.778008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.792417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:24.793714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:24.860529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bea5-15ec-41de-850e-ae646959da4a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:24.871377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 151/301] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:24.871377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:24.896310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:24.896849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:24.897083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:24.897343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:24.898228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=c6134e16daa441b7869a897e6d6a611a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:24.898470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:24.899971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:24.906006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 151/302] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/role_assignments?user.id=c6134e16daa441b7869a897e6d6a611a&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=0923251e0e694650be6c27d7aafe4826 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:24.906768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.013838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c330d-b6c5-4eca-a5f0-9de310d6eb33 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.022167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.044836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.047551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe921-1fcc-4993-895d-267da594f65f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.062784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633fc22-c485-4235-b834-fd91394499df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.064042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633fc22-c485-4235-b834-fd91394499df None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.064594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633fc22-c485-4235-b834-fd91394499df None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.065083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633fc22-c485-4235-b834-fd91394499df None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.066154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633fc22-c485-4235-b834-fd91394499df None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:25.066700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633fc22-c485-4235-b834-fd91394499df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.068460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633fc22-c485-4235-b834-fd91394499df None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.078251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 152/303] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:25.079603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633fc22-c485-4235-b834-fd91394499df None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.096567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.097611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.097891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.098161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.098927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:25.099236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.103286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.118531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 152/304] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:25.119772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.208942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633fc22-c485-4235-b834-fd91394499df None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.238819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffde6f-7bc0-4542-a449-8604bedaa352 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.243521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.244561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.245049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.245511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.246866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.248616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.250426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 153/305] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:25.251358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.277836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.278676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.278958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.279226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] PATH_INFO: `/v3/users/db71648b43a84360a70ba1507268f551` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.280500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] RBAC: Authorizing `identity:get_user(user_id=db71648b43a84360a70ba1507268f551)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.281915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.283564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 153/306] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:25 2022] GET /identity/v3/users/db71648b43a84360a70ba1507268f551 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:25.284291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.302462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.311495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.362788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd706-607e-4306-9fbd-53453214889e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.391291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34b52-b811-4e6f-ad59-86fd5485a11c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.397537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.398421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.398699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.398969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] PATH_INFO: `/v3/users/00e36c31cf00477bb0dabdb5d08e23bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.413384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] RBAC: Authorizing `identity:get_user(user_id=00e36c31cf00477bb0dabdb5d08e23bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.414860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.421263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 154/307] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:25 2022] GET /identity/v3/users/00e36c31cf00477bb0dabdb5d08e23bb => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:25.421263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.438080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.438773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.439057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.439329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] PATH_INFO: `/v3/groups` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.440053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.441545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.458294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 154/308] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 23 13:26:25 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:25.459231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:25.535418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f28e6-3b25-42ef-a12a-7456a05a8f47 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.547037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.562439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:25.580921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.582274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.582825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.583353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] PATH_INFO: `/v3/system/users/db71648b43a84360a70ba1507268f551/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.585484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db71648b43a84360a70ba1507268f551, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.587313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee3127-9d36-4c43-a11b-2d368458434d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.600679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1103-4451-45a7-8075-a510de467acf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:25.603014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 155/309] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 23 13:26:25 2022] PUT /identity/v3/system/users/db71648b43a84360a70ba1507268f551/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:25.644940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:25.645674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:25.645954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:25.646225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:25.647077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, user.id=00e36c31cf00477bb0dabdb5d08e23bb, scope.system=all) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:25.647462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:25.649109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf380b-ca13-43f9-a2ad-28fe668d6bf8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:25.655299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 155/310] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 23 13:26:25 2022] GET /identity/v3/role_assignments?user.id=00e36c31cf00477bb0dabdb5d08e23bb&scope.system=all&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:26.376070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822cae-1169-4c19-b199-1c3b7665477d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:26.377063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822cae-1169-4c19-b199-1c3b7665477d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:26.377547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822cae-1169-4c19-b199-1c3b7665477d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:26.379165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 156/311] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:26.384491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:26.385302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:26.385780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:26.403570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:26.405130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:26.474603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 156/312] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:26.498138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32822cae-1169-4c19-b199-1c3b7665477d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:26.604096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32822cae-1169-4c19-b199-1c3b7665477d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:26.642070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:26.643219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:26.643741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:26.644231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:26.655163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:26.663172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:26.664093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:26.664873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:26.671640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 157/313] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:26.673695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:26.743388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:26.780420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160165e-03bc-45fa-be78-9d811f73acff None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:26.815842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:26.816981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:26.817463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:26.817957 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:26.818927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:26.819449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:26.821132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:26.830114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 157/314] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:26.835899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:26.869061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:26.939859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06d7d1-690c-42a0-9427-81a25268b35f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:26.974104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:26.975288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:26.975839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:26.976316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] PATH_INFO: `/v3/users/ed5edef48c884d5aa5142aa4128a3e32` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:26.977701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] RBAC: Authorizing `identity:get_user(user_id=ed5edef48c884d5aa5142aa4128a3e32)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:26.979377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:26.981323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 158/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:26 2022] GET /identity/v3/users/ed5edef48c884d5aa5142aa4128a3e32 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:26.987893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.103716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135bd4c-b76f-4a72-8881-6c6993f1af9b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:27.135766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:27.139717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:27.140581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.140930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.141358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.210529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:27.211981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:27.313644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 158/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:26:27.319206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.422416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:27.428030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cc87d-5318-4c99-b4ff-a2c2d502ff28 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:27.463041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:27.463873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.464154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.464431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.465638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:27.467645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba9611-d723-4891-b4da-498a39e27e81 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:27.469687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 159/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:27 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:27.475555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.507771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:27.546909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8262-610b-469e-8905-920eb341e970 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.547594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8262-610b-469e-8905-920eb341e970 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.548064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb8262-610b-469e-8905-920eb341e970 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.549874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 160/318] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:27.554937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2608-1d1d-40ed-ab7c-e8bbf162e177 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.555220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2608-1d1d-40ed-ab7c-e8bbf162e177 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.555520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2608-1d1d-40ed-ab7c-e8bbf162e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.572961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-943d2608-1d1d-40ed-ab7c-e8bbf162e177 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:27.574246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-943d2608-1d1d-40ed-ab7c-e8bbf162e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:27.581380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69ad1-1638-4c74-be06-9979cb3e6a5c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:27.625401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:27.626221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.626519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.626796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.627965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, scope.project.id=437c8f447dad4dae81cbe0ad2b293026, user.id=ed5edef48c884d5aa5142aa4128a3e32) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:27.628283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:27.629757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:27.643442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 159/319] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:27 2022] GET /identity/v3/role_assignments?user.id=ed5edef48c884d5aa5142aa4128a3e32&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:27.655563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 161/320] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:27.672772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.692016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb84cc-0b1c-4b60-8505-9bb7686788c5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.692612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb84cc-0b1c-4b60-8505-9bb7686788c5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.693083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb84cc-0b1c-4b60-8505-9bb7686788c5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.694704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 162/321] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:27.700643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9144a6-244c-448d-8294-28920b54ba5f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.701255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9144a6-244c-448d-8294-28920b54ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.701722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9144a6-244c-448d-8294-28920b54ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.720338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-df9144a6-244c-448d-8294-28920b54ba5f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:27.721473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-df9144a6-244c-448d-8294-28920b54ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:27.777995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:27.789502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a5613-ffb6-4d43-9669-01552109498b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:27.793914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 163/322] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:27.795538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6e91-e9b3-4137-8570-d9da51395d4b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.795876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6e91-e9b3-4137-8570-d9da51395d4b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.796207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6e91-e9b3-4137-8570-d9da51395d4b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.801664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 164/323] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:27.803921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.804203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.804477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.824467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:27.825709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:27.833022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:27.834136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.834421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.834700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:27.835994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:27.837470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:27.840266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 160/324] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:27.840266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.857896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:27.904012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 165/325] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:27.904847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:27.956756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74e5f-dea1-4d49-8360-559712af9a83 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:27.989093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:27.989858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:27.990136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:27.990408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.001038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:28.003265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1474c-833e-4393-b7dc-7999edccd797 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:28.008789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:28.009877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:28.010671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 161/326] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:28.011368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.035414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:28.039653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.040409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.040610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.040885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] PATH_INFO: `/v3/groups` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.041696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.043026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.058385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 166/327] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 23 13:26:27 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:28.060336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.085491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:28.132232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8a7e-a09c-4743-a1d6-09fd5c2e6698 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.169074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.169981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.170266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.170996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.183118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fce62-2fe0-4181-90f2-d52c94e28217 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.183484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:28.191541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:28.192500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:28.193299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:28.195671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 162/328] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:28.199059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.224650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.224995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.225266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.225538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.226291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:28.226593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.228010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.239587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 167/329] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:28.244895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.298371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:28.326465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8080d-31c7-4d82-9358-936e803a1ebf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.348793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:28.372737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.373670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.373952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.374226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.374990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:28.375296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.376765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.377412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa9ef-ec11-41e6-8ff3-9024c34223f2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.387449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 163/330] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:28.393859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.426983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.427972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.428808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.428808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] PATH_INFO: `/v3/users/db71648b43a84360a70ba1507268f551` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.429806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] RBAC: Authorizing `identity:get_user(user_id=db71648b43a84360a70ba1507268f551)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.431442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.433272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 168/331] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/users/db71648b43a84360a70ba1507268f551 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:28.439558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.521945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaede65-4cb9-44a0-a8ef-c1282c84b0c7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.561455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.562460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.562739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.563118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] PATH_INFO: `/v3/users/00e36c31cf00477bb0dabdb5d08e23bb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.564358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] RBAC: Authorizing `identity:get_user(user_id=00e36c31cf00477bb0dabdb5d08e23bb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.565823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.566246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d6f8c-70b6-408e-bd38-16bb7eba0c65 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.571357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 164/332] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/users/00e36c31cf00477bb0dabdb5d08e23bb => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:28.573616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:28.592697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:28.624236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.624900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.625175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.625447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.626281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] RBAC: Adding query filter params (role.id=0923251e0e694650be6c27d7aafe4826, user.id=db71648b43a84360a70ba1507268f551, scope.system=all) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:28.626591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.628181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de558-4d99-4940-b7e0-1696773b01a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.641981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 169/333] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 23 13:26:28 2022] GET /identity/v3/role_assignments?user.id=db71648b43a84360a70ba1507268f551&scope.system=all&role.id=0923251e0e694650be6c27d7aafe4826 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:28.706902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617bcab-421b-4a2f-8c52-e9dabf345f4d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:28.746695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:28.747991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:28.748513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:28.748930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] PATH_INFO: `/v3/system/users/00e36c31cf00477bb0dabdb5d08e23bb/roles/f057ca8dd524469a8d73b0e16829b698` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:28.750620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=00e36c31cf00477bb0dabdb5d08e23bb, role_id=f057ca8dd524469a8d73b0e16829b698)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:28.752222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517eed1-5442-41d4-a304-49470f3b7753 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:28.766789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 165/334] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 23 13:26:28 2022] PUT /identity/v3/system/users/00e36c31cf00477bb0dabdb5d08e23bb/roles/f057ca8dd524469a8d73b0e16829b698 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:26:30.280375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630e43-e8ee-47be-9ec6-8534d691b5df None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:30.280881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630e43-e8ee-47be-9ec6-8534d691b5df None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:30.280956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630e43-e8ee-47be-9ec6-8534d691b5df None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:30.282548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 170/335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:30.287977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:30.288367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:30.288532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:30.311205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:30.312430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:30.407081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:30.451155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09630e43-e8ee-47be-9ec6-8534d691b5df None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:30.461047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:30.580236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09630e43-e8ee-47be-9ec6-8534d691b5df None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:30.624990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:30.625810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:30.626093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:30.626372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:30.642154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:30.649998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:30.650880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:30.651721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 171/337] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:30.657256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:30.660477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:30.787179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b13cf-7248-488b-86ad-4bef1ebf92ec None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:30.835012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:30.835776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:30.836062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:30.836340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:30.837205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:30.837514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:30.838937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:30.851704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 167/338] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:30.857327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:30.936695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:30.976147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c354f-dbd7-4316-a41c-44c88abe31fa None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:31.023522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:31.024184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.024467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.024747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.121495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:31.123028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d85a-3cb8-4f90-98dc-f994675f4ee7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:31.209268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:31.252013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 172/339] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:31.257745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.340049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:31.367708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e529aa-a7fc-4662-a63c-7fd4a830128b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.368219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e529aa-a7fc-4662-a63c-7fd4a830128b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.368452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e529aa-a7fc-4662-a63c-7fd4a830128b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.369815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 173/340] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:26:31.375243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60713-e3d8-49d4-8727-ecb76b1fbb8f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.375551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60713-e3d8-49d4-8727-ecb76b1fbb8f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.375839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60713-e3d8-49d4-8727-ecb76b1fbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.400383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-13b60713-e3d8-49d4-8727-ecb76b1fbb8f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:31.401595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-13b60713-e3d8-49d4-8727-ecb76b1fbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:31.407399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b6a3-4b45-4be3-8581-926644e8b61e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:31.465519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:31.466744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.467030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.467301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.469050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:31.470530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbb8db-5132-4a48-a3de-18e6092237be None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:31.478459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 168/341] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:31.479998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f81d-b2c2-4925-848b-362e23fbec6f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.480287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f81d-b2c2-4925-848b-362e23fbec6f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.480579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f81d-b2c2-4925-848b-362e23fbec6f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.482229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 169/342] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:31.483293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886844-f3d5-4245-8541-c8e88485acac None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.483745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886844-f3d5-4245-8541-c8e88485acac None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.484024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886844-f3d5-4245-8541-c8e88485acac None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.489191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 170/343] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:31.489997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886844-f3d5-4245-8541-c8e88485acac None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.530102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 174/344] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:31.537091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13c6c-d467-4992-8905-96ef209c8a9b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.537382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13c6c-d467-4992-8905-96ef209c8a9b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.537787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13c6c-d467-4992-8905-96ef209c8a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.564579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5bc13c6c-d467-4992-8905-96ef209c8a9b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:31.566116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5bc13c6c-d467-4992-8905-96ef209c8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:31.630504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886844-f3d5-4245-8541-c8e88485acac None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:31.655478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 175/345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:31.656875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.657163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.657440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.669028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:31.670268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.670748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.671227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.678222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:31.680104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:31.680838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:31.682127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:31.682541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 171/346] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:31.683515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.687625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:31.716204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:31.775718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 176/347] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:31.776665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.819742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad54bb-dd73-4a55-a2de-03aceea2ed99 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:31.857631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:31.858460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.858749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.859033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.870630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:31.878619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:31.879578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:26:31.880390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:31.881457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:31.882207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.893068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ef0f-9a43-4223-9559-ca0df6ad89cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:31.933921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:31.934627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:31.934941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:31.935215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:31.936083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=51c51146274043308cc062f293d361dd) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:31.936394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:31.937845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:31.944628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 177/349] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=51c51146274043308cc062f293d361dd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:31.945524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:31.959852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:31.971834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.005954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff27ad-a463-4412-8ccf-c2c9b3334b31 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.043324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.044550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.044981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.045454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.060650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:32.062842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cb7f9-9abb-458e-be72-d2de4e83a539 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:32.069608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:32.070643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:32.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:32.074036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 173/350] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:32.075094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.105697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.108701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.108892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.109204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.123573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:32.133156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:32.134201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:32.135009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:32.140125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 178/351] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:32.140125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.235890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bdbb-bff2-4755-8648-db93a1fbed36 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.258312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.259497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.284249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.284931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.285213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.285485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.286239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:32.286540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.286778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d9667-d80e-429a-ac30-cc32cd28adb6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.288002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.299020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 174/352] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:32.304234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.332612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.333693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.334205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.334667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.335641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:32.336165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.337945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.353741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 179/353] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:32.354955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.435503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b826-c1fa-4d56-85b0-24e61e4859d5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.479577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.480489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.480776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.481097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.481982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:32.482283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.482552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b0455-049e-41fe-9977-b6ecad719763 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.483759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.495293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 175/354] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:32.496173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.531963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.533267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.533768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.534257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] PATH_INFO: `/v3/users/00e36c31cf00477bb0dabdb5d08e23bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.535793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] RBAC: Authorizing `identity:get_user(user_id=00e36c31cf00477bb0dabdb5d08e23bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.537465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2169e9-b577-4377-94b7-2654748051c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.539384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/users/00e36c31cf00477bb0dabdb5d08e23bb => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:32.540826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09841b2-9af2-467b-9970-32cb4474d7c4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.541341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09841b2-9af2-467b-9970-32cb4474d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.541829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09841b2-9af2-467b-9970-32cb4474d7c4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.545461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 181/356] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:32.546485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09841b2-9af2-467b-9970-32cb4474d7c4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.558275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.561842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.632398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f221a2-cd81-4e2b-824e-e8a7cbcb3db0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.678720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.679124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09841b2-9af2-467b-9970-32cb4474d7c4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:32.680009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.680847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.681341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.733983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:32.735181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.735996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.736727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.786149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.787774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffb164-e857-4b36-bdf8-5c882a5b2f42 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.832362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:32.833010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:32.837766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.847378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:32.903164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 176/357] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:32.905040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:32.905547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:32.906023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:32.923415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:32.925088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:32.951434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 182/358] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:32.952182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:32.998202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 177/359] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:32.999660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.062555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfd0d-81aa-40d1-a63d-2533327ea74d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.078259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.095936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.116645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.117307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.117585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.117857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.118700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] RBAC: Adding query filter params (role.id=f057ca8dd524469a8d73b0e16829b698, user.id=00e36c31cf00477bb0dabdb5d08e23bb, scope.system=all) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:33.119009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.120493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.134374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 183/360] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/role_assignments?user.id=00e36c31cf00477bb0dabdb5d08e23bb&scope.system=all&role.id=f057ca8dd524469a8d73b0e16829b698 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.135053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.135740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530f7e7-cf9e-45b8-b4e1-4b953aa33d01 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.185045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.186313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.186687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.187474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.188968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.191156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.192979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 178/361] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:32 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.195367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.254224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eec93-7957-48fb-b35e-88c3f2cce20a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.298859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.300375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.300663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.300942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.302719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.304977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1bfe-6d38-4603-95df-4ef7112b1f7e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.307945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 184/362] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.309509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02c2b-526c-4334-86fe-e9f80e4a4573 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.309852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02c2b-526c-4334-86fe-e9f80e4a4573 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.310133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02c2b-526c-4334-86fe-e9f80e4a4573 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.311483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 185/363] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:33.312189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02c2b-526c-4334-86fe-e9f80e4a4573 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.341569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2125b-b3b0-44b8-bc8f-b7d6acd29575 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.363818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.388649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.389768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.390194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.390607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.401923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.408054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:33.418236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:33.419599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:33.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:33.426403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 179/364] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:33.426403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.462551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02c2b-526c-4334-86fe-e9f80e4a4573 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.501537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.503291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.503770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.504243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.505711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.507259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76c1be-7644-4d8f-b0d0-ca9e3470a3e3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.509090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 186/365] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.510232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.510508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.510784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.532146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:33.533579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:33.549491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b8d0-32e0-4a67-b907-b6e7cda425bd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.589061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.589948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.590231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.590506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.592250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.593670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.595318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 180/366] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.597047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.613769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 187/367] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:33.614894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.655248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.691625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.744857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546450-6aae-4972-b731-f1824ddb4069 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.745723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2226a-1fb3-41dc-b002-872c98a58bcc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.785328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.785996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.786362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.786718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.787618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=51c51146274043308cc062f293d361dd) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:33.787895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.789477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.790689 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.791597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.791890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.792170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.792943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:33.793745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.795550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.796868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 188/368] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=51c51146274043308cc062f293d361dd&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.797554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.805723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 181/369] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.806709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.914558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.918254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52060b6-05b3-42d4-a097-0b93e03247d5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.936953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575801dc-e4cf-4952-84ef-79a09cda2ab9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:33.957608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.958444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.958551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.958823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:33.959738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=437c8f447dad4dae81cbe0ad2b293026) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:33.960033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:33.961518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:33.969618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 189/370] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=0923251e0e694650be6c27d7aafe4826 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:33.970328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:33.979197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:33.988669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:33.990097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:33.990581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:33.991083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.015294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:34.028708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:34.029679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:34.030963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 182/371] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:34.036985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.081805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647641c-8f1e-4c0e-926c-72fd077a4180 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.120238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.120915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.121198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.121476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.156928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.199301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:34.200749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:34.301292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86371-6edc-454f-8a57-e945329b7c5f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.317900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 190/372] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:34.323706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.387017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.388205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.388794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.389310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.390269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:34.390787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:34.391388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.393860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:34.404680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 183/373] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:34.412568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.437480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003495f-dc54-4ee1-a664-a21dfb384f19 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.470676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.471502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.471787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.472060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.473399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:34.474719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d62a4-81d9-41f2-8820-bcaf6eb97ea3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:34.477097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 191/374] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:34.478025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e9f6-9564-4295-a9ab-ee171564507f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.478307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e9f6-9564-4295-a9ab-ee171564507f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.478664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e9f6-9564-4295-a9ab-ee171564507f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.480095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 192/375] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:34.487044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.487493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.487903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.505660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:34.507002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:34.507487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.573780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59a4bb-0369-4003-92d6-831390f0eeff None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.593790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 193/376] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:34.595415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.618049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.618721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.619006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.619286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.658106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.697769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:34.699271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:34.713525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c541e6-6d4b-4957-8622-ef328954dd89 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.763068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.766237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.767348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.767638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.767913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.769698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:34.771497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:34.774141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 194/377] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:34.774717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.835574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 184/378] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:34.836722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:34.895282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dde8-e633-461b-8dc6-60bdc3d53e76 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.929520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:34.937354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:34.938261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:34.938708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:34.939054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:34.952046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:34.960595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:34.962874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:34.964910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:34.966685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475d68-1bae-4fd9-acea-c9f08eb832d9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:34.966846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 195/379] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:34.966846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.005188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.005188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.005188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.005188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.005986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=437c8f447dad4dae81cbe0ad2b293026) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:35.005986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.007717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.018081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 185/380] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:35.019116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.057210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:35.078418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d8b04-cc64-4379-9fef-1e47949e3f16 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.128712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.129763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.130146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.130517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] PATH_INFO: `/v3/projects/ee8652e385f24bd9be7726e25f653946` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.133384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] RBAC: Authorizing `identity:get_project(project_id=ee8652e385f24bd9be7726e25f653946)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.135151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.137483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 196/381] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:34 2022] GET /identity/v3/projects/ee8652e385f24bd9be7726e25f653946 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:35.144583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.228460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:35.236976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71823-4b4e-41ac-8ae5-30b9292ad984 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.281120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.281727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.282215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.282319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.283045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:35.283393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.284934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.292578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a5c3-b1b0-404a-a4e4-43157f7ffa01 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.306893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 186/382] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:35.312510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.340172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.343107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.345047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.345471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] PATH_INFO: `/v3/groups/20190b8fcba5483793c7df8ef5fd54f3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.359067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] RBAC: Authorizing `identity:get_group(group_id=20190b8fcba5483793c7df8ef5fd54f3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.361473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.366904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 197/383] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:35 2022] GET /identity/v3/groups/20190b8fcba5483793c7df8ef5fd54f3 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:35.393390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.478861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:35.541368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bd15-c904-4a6d-88fa-464ed3e64934 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.555908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4699-17a5-4fac-9700-969a941193c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.579529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:35.599276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.600573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.600859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.601138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.601991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] RBAC: Adding query filter params (group.id=20190b8fcba5483793c7df8ef5fd54f3, role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=ee8652e385f24bd9be7726e25f653946) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:35.602303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.603819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.619859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 198/384] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:35 2022] GET /identity/v3/role_assignments?group.id=20190b8fcba5483793c7df8ef5fd54f3&scope.project.id=ee8652e385f24bd9be7726e25f653946&role.id=77bb21c1be16493181bb82f412685ca2 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:35.621853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.622814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.623097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.623407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.624724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.626241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.628404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 187/385] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:35 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:35.633730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.774297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce824-1292-44d8-b8a5-45f32d58d023 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:35.815082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:35.815968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:35.816293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:35.816571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:35.817816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:35.819290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62589-ba78-49f7-958f-53cc3b29f9a0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:35.821440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 199/386] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:35 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:35.826833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:35.945748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa4bd-791f-4718-abfd-4612c83c899b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:36.001041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:36.001949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.002231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.002504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.004517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, group_id=8c334d7d7ae4468ca1d1a94f64d50a58, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:36.006004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ced7d-cdb6-42f2-85d9-668c756bb8aa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:36.034000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 188/387] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 23 13:26:35 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:36.324879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697b95-15f1-418f-b437-2a9b5d7415fb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.325309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697b95-15f1-418f-b437-2a9b5d7415fb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.325503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697b95-15f1-418f-b437-2a9b5d7415fb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.328561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 200/388] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:36.334003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859b44-5f0d-4695-9e5a-8ea410de608c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.334289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859b44-5f0d-4695-9e5a-8ea410de608c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.334567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859b44-5f0d-4695-9e5a-8ea410de608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.346993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:36.356978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3e859b44-5f0d-4695-9e5a-8ea410de608c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:36.358222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3e859b44-5f0d-4695-9e5a-8ea410de608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:36.436922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 189/389] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:36.467073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9697b95-15f1-418f-b437-2a9b5d7415fb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:36.537606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:36.605233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9697b95-15f1-418f-b437-2a9b5d7415fb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:36.615859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfa5b-b588-4127-a513-12446f8add4e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.616147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfa5b-b588-4127-a513-12446f8add4e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.616326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfa5b-b588-4127-a513-12446f8add4e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.617965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 190/390] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:36.623986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.624530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.624530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.654779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:36.656018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:36.663896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:36.664723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.665005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.665279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.698806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:36.710777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:36.711793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:36.712580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:36.719632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 201/391] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:36.725450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:36.777872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 191/392] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:36.800585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:36.879213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:36.905545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69399f2-5362-4f88-b37e-98fb009590d8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:36.922450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1074-ce9f-4370-8b0e-ebabf826868f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:36.927956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:36.975858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:36.976904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.977386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.977856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:36.978836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:36.979519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:36.982005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:36.986374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:36.987521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:36.988859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:36.992013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.000234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 202/393] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:37.006529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.010287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:37.028029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:37.029034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:37.029832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:37.033074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 192/394] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:37.040392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.167994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04e4-3e7b-4f00-ad93-c500623d0b7c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.245436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.246710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.247192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.247730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.249197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.251125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.255760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 203/395] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:37.264483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.280457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319556b8-e066-455c-9ea5-542049e87958 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.331288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:37.333588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:37.353816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.354906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.355392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.355843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.356967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:37.357451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.360195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.374888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 193/396] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:37.381704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.455366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68aa18-ccbc-4646-9d51-00665b3f65cf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.513428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.514643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.515147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.515664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.517338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.519000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.521801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 204/397] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:37.527421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.603280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441639e-b181-4301-8c6d-e9ff2adfdc76 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.646777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.651308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.651308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.651308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.654351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.655188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13563e6-ba71-4df2-93e9-b998837aa6ba None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.657243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 194/398] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:37.661252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9bd8-6c12-47b6-b357-ec9bc490a444 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.661831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9bd8-6c12-47b6-b357-ec9bc490a444 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.662782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9bd8-6c12-47b6-b357-ec9bc490a444 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.665074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 195/399] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:37.666112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9bd8-6c12-47b6-b357-ec9bc490a444 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.689537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0eff-87b5-4d9a-807d-ce8e2f391f57 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.704234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:37.739680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.740784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.741119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.741401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.744982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] RBAC: Authorizing `identity:create_grant(project_id=51c51146274043308cc062f293d361dd, group_id=8c334d7d7ae4468ca1d1a94f64d50a58, role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.747362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0205f-3c90-43e5-9041-71d9cba1989f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.749746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:37.768030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 205/400] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 23 13:26:37 2022] PUT /identity/v3/projects/51c51146274043308cc062f293d361dd/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:26:37.771508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.772032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.772557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.810529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:37.812287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:37.845242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9bd8-6c12-47b6-b357-ec9bc490a444 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:37.901919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:37.903296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:37.903836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:37.904390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:37.906810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:37.909086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:37.911173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 196/401] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:37.917439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:37.967665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 206/402] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:37.999056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.097416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a054-8772-47a4-a97e-5fa0b722e1ed None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.134872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:38.155725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:38.159905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11250ed-530b-4b1a-99ee-8f9994b0ef09 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.168239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.169187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.169467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.169783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.173888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, group_id=8c334d7d7ae4468ca1d1a94f64d50a58, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:38.175627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:38.198953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 197/403] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 23 13:26:37 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:38.259187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.259994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.260271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.260544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.282961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6db96366-b515-45e4-8f1c-f41a876dcf96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:38.292383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:38.293368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:38.294651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 207/404] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:38.300278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.383288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed78e6-a5dc-4410-be39-df6758661654 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.383636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed78e6-a5dc-4410-be39-df6758661654 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.383887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed78e6-a5dc-4410-be39-df6758661654 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.385540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 208/405] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:38.391499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.391795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.392051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.409470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:38.410700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:38.443276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73ec7-58e1-40de-a48b-76e3eacb08fe None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.492591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.493656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.494164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.494732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.495720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:38.496239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 209/406] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:38.496513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:38.498240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:38.507559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 198/407] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:38.513033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.526203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.598163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:38.627741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:38.638843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b35cce-09b8-466b-a5a0-54bb379cb61d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.710815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.712530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.713344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.713622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.715013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:38.716921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18268832-50f2-40d6-af9b-fb64e4c1e7b7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:38.717929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df2ee-88f4-453e-adf4-9988b0d7a012 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.718576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 210/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:38.719927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148075f-eb4f-427d-ac94-4d5b6581d617 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.720217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148075f-eb4f-427d-ac94-4d5b6581d617 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.720495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148075f-eb4f-427d-ac94-4d5b6581d617 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.721713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 211/409] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:38.726658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148075f-eb4f-427d-ac94-4d5b6581d617 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.755237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.756443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.756938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.757416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.768530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4c1322f9-c2d5-44b9-b729-b31d78fde770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:38.776587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:38.777498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:38.778353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:38.781091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 199/410] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:38.782528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.783013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.783515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.800657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:38.802131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:38.839870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148075f-eb4f-427d-ac94-4d5b6581d617 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:38.870567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 200/411] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:38.871827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.890408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:38.891897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:38.892359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:38.892814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:38.896249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:38.897751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:38.899894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 212/412] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:38.903021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:38.920121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:38.935263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.014786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab25a-35b0-4742-82e8-e573bf73bab6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.017898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26073-ad6e-4e11-9c61-b652a277ffe5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.054289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.054927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.055201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.055553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.056274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:39.056576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.057975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.071736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 201/413] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:39.071736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.077613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.078623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.079075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.079580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.099610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:39.109780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:39.110734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:39.111617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 213/414] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:39.112284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.189283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.193920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959f942-0024-49ad-a169-c97d1d549119 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.225481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.231067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.232287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.233079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.233614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.236149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] RBAC: Authorizing `identity:create_grant(project_id=437c8f447dad4dae81cbe0ad2b293026, group_id=8c334d7d7ae4468ca1d1a94f64d50a58, role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.237818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.247891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014909d-d5ab-48e4-9ee7-887081c4d5bb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.253560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 202/415] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 23 13:26:39 2022] PUT /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026/groups/8c334d7d7ae4468ca1d1a94f64d50a58/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:39.254466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.320791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.322466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.323152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.323760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] PATH_INFO: `/v3/groups/20190b8fcba5483793c7df8ef5fd54f3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.325704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] RBAC: Authorizing `identity:get_group(group_id=20190b8fcba5483793c7df8ef5fd54f3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.335815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.338441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 214/416] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:39 2022] GET /identity/v3/groups/20190b8fcba5483793c7df8ef5fd54f3 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:39.344956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.380561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce97a9-cd62-48cb-8867-8930d4ac00fa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.426160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.427221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.427552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.427828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.428587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] RBAC: Adding query filter params (name=member) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:39.428892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.430307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.442938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 203/417] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:39.449005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.478035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.487851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef506-5cee-433e-9788-eb4434062724 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.527749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.529368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.530563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.531040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] PATH_INFO: `/v3/projects/ee8652e385f24bd9be7726e25f653946` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.532679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] RBAC: Authorizing `identity:get_project(project_id=ee8652e385f24bd9be7726e25f653946)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.534458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.541705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 215/418] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:39 2022] GET /identity/v3/projects/ee8652e385f24bd9be7726e25f653946 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:39.543202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.576715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142d72-a2e4-4ab9-9454-d61e73a7fefe None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.593400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.620332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.621445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.621928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.622676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.709337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.711198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.720027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f16dc-cb87-40a6-bc60-92d8c36d7266 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.736037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.755056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.755970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.756251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:39.756527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] PATH_INFO: `/v3/projects/ee8652e385f24bd9be7726e25f653946/groups/20190b8fcba5483793c7df8ef5fd54f3/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:39.758642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8652e385f24bd9be7726e25f653946, group_id=20190b8fcba5483793c7df8ef5fd54f3, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:39.759981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:39.785449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 216/419] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 23 13:26:39 2022] PUT /identity/v3/projects/ee8652e385f24bd9be7726e25f653946/groups/20190b8fcba5483793c7df8ef5fd54f3/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:39.845483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 204/420] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:39.850760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:39.951937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:39.959952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb99e-3451-4c74-a74a-af58944647c9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:39.998690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:39.999606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:39.999897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.000158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.001354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:40.002819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe9605-62b6-49a5-a6f2-f8d7e733cc8d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:40.004877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 217/421] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:39 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:40.012486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.132612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208fa-95df-457c-9d76-b68b458ada10 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:40.138652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e65-baa9-408e-af43-87b598023943 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.138934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e65-baa9-408e-af43-87b598023943 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.139214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e65-baa9-408e-af43-87b598023943 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.140895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 218/422] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:40.148116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.148665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.149139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.158605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:40.167509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:40.169073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:40.174563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:40.175474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.175758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.176031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.177295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:40.179214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:40.181268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 205/423] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:40.195363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.253500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 219/424] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:40.299550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.313063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896e04f-a3ef-4f91-a104-ab5c311339b6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:40.351522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:40.352337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.352629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.352905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.353748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=51c51146274043308cc062f293d361dd) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:40.354061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:40.355598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:40.362450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 206/425] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=51c51146274043308cc062f293d361dd&role.id=0923251e0e694650be6c27d7aafe4826 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:40.488198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:40.515557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11538f4a-5f83-431f-8f50-a04d01207fab None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:40.568689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:40.569981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.570267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.570543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.583223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a2e6bcf6-60cb-4a1c-ac43-bd5e5b557818 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:40.591913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:40.592803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:40.594021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 220/426] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:40.600745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.675981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:40.731786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227d75c-a9e0-49c6-ab78-cc9ad6ebb951 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:40.768999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:40.770052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfcd0-5269-4e43-9a8b-e3b143f4befb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.770447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfcd0-5269-4e43-9a8b-e3b143f4befb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.770627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfcd0-5269-4e43-9a8b-e3b143f4befb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.771230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.771737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.772016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 221/427] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:40.772468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.773426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:40.773977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:40.775890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:40.777643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.777928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.778238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:40.797059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 207/428] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:40.800510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:40.801928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:40.804859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.888114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 222/429] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:40.923364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf0613-98fb-4f00-9b47-c69bd681217a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:40.930340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:40.940465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:40.971990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:40.973121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:40.973646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:40.974112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.021468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.056431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.058529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.061266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dabf5e-b0d9-4178-b7af-990da8f75eda None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.114081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.115203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.115726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.116196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.128475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:41.137259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:41.138198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:26:41.139003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:41.145572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 223/430] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:41.148228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.184527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 208/431] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:26:41.189954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.205722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.264653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3326c8-0269-411e-ad3c-8915edce06a8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.295722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f3d5-a66b-43c1-89f2-2bbefef6465d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.298392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.306931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.308028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.308527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.309015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.310052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] RBAC: Adding query filter params (name=member) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:41.310556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.313235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.327454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 224/432] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:41.330156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.333822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.335421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.335421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.335421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] PATH_INFO: `/v3/projects/51c51146274043308cc062f293d361dd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.336625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] RBAC: Authorizing `identity:get_project(project_id=51c51146274043308cc062f293d361dd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.338106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.343574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 209/433] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/projects/51c51146274043308cc062f293d361dd => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:41.347114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.429876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.449823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669f495-6369-405a-a89c-e655df2c9768 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.451325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01119f-a0a7-4b02-8b64-ac472b12595a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.485222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.486205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.486512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.486852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.488058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.488295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.489266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.489527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.490133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.490658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.495499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 210/434] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:41.497050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.568848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.580255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.581748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.616827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aa935-998b-4284-b8dd-c2e61ab4b6d8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.652464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.653573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.654075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.654541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.655669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=51c51146274043308cc062f293d361dd) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:41.656241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.657944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b189-6153-4211-9ac9-8699bbcb0249 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.671761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 211/435] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=51c51146274043308cc062f293d361dd&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:41.690785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 225/436] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:26:41.692859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80095-3f0c-4f72-b7fa-b45acd12d276 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.693371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80095-3f0c-4f72-b7fa-b45acd12d276 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.693547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.694043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80095-3f0c-4f72-b7fa-b45acd12d276 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.696042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 212/437] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:41.704237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.704536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.704719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.722661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:41.724112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:41.737512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.794929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:41.806095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747445-ec5a-42b3-bec7-e8e8a564660e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.823561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 213/438] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:41.839830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.850421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:41.851481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:41.851766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:41.852041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:41.853273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:41.854725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:41.856565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 226/439] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:41.862082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:41.967601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606907b-3a70-4f7b-b4e2-0a5ac95fd6f0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:41.978044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac32c0-5edb-4f3c-9bd3-958d3d43d649 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.007844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.008711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.008996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.009273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.015915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.017045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.017328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.017601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.018804 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.020655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.022636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 227/440] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:42.026316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:42.030270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:42.036284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:42.037337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:42.038331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 214/441] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:42.044153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.048644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.069200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.155458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1a96-1f43-4dcb-b5f4-0ae3f6877f73 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.185159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a387-38c7-4f9b-8354-8c38d54d6ce7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.193554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.194230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.194516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.194790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.195662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=0923251e0e694650be6c27d7aafe4826, scope.project.id=437c8f447dad4dae81cbe0ad2b293026) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:42.195978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.197432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80aa1-7058-4e06-b0ed-dd691ae7ff42 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.207468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 228/442] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=0923251e0e694650be6c27d7aafe4826 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:42.228335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.228949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.229229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.229505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.230282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:42.230600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.232196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.241798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 215/443] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:42.247372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e282cd-cfc1-4dab-a4c8-0b001481cc84 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.247670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e282cd-cfc1-4dab-a4c8-0b001481cc84 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.247857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.247952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e282cd-cfc1-4dab-a4c8-0b001481cc84 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.249558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 229/444] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:42.254983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.255269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.255568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.273850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:42.275068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:42.320549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.351668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 230/445] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:42.364309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcf394-b8c9-4304-be7c-ba02c6f18b99 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.375058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.400593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.403539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.404228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.404518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.404795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.485828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.487226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.496173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086ca17-6153-48d0-9925-ee66e583224c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.542217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.543075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.544063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.544063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.556022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:42.557125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:42.564590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:42.565551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:42.566358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 231/446] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:42.571244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.599991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 216/447] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:26:42.605511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.662962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.684008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84f89-1ae3-45ce-ab01-e4c4067871c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.716725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356857fd-ab5e-4847-a7ed-f5f17adabb16 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.717706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.718379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.718629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.718889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.719689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:42.719972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.721397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.729698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 232/448] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:42.735310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.752403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.753226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.753527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.753819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] PATH_INFO: `/v3/projects/437c8f447dad4dae81cbe0ad2b293026` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.755104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] RBAC: Authorizing `identity:get_project(project_id=437c8f447dad4dae81cbe0ad2b293026)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.756702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.758435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 217/449] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/projects/437c8f447dad4dae81cbe0ad2b293026 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:42.763872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.796590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.838452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec22752-6e9f-49d8-bbf4-3244ea30a80f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.864439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c3c7-6351-4321-bcba-dd48ec3e22f5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:42.874318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.874992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.875288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.875612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.891085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:42.899694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:42.900566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:42.900825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:42.901086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] PATH_INFO: `/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:42.902300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] RBAC: Authorizing `identity:get_group(group_id=8c334d7d7ae4468ca1d1a94f64d50a58)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.903877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:42.905495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 218/450] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/groups/8c334d7d7ae4468ca1d1a94f64d50a58 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:42.911322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:42.944640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:42.946128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:43.010370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75abfca-19e6-4cc4-9ce6-d1a8726af951 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:43.012101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:43.043167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 233/451] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:43.048589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:43.048898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:43.049241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:43.049518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:43.049785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:43.050633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] RBAC: Adding query filter params (group.id=8c334d7d7ae4468ca1d1a94f64d50a58, role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=437c8f447dad4dae81cbe0ad2b293026) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:43.050939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:43.052394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:43.058179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 219/452] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:42 2022] GET /identity/v3/role_assignments?group.id=8c334d7d7ae4468ca1d1a94f64d50a58&scope.project.id=437c8f447dad4dae81cbe0ad2b293026&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:43.097945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:43.157234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3831a-acc2-4cb2-8ddf-25ca574d7bd7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:43.194057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b637-8711-489e-9d63-192565177269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:43.194939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b637-8711-489e-9d63-192565177269 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:43.195216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b637-8711-489e-9d63-192565177269 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:43.195524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b637-8711-489e-9d63-192565177269 None admin] PATH_INFO: `/v3/projects/ee8652e385f24bd9be7726e25f653946` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:43.196786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90b637-8711-489e-9d63-192565177269 None admin] RBAC: Authorizing `identity:get_project(project_id=ee8652e385f24bd9be7726e25f653946)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:43.198253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90b637-8711-489e-9d63-192565177269 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:43.200146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 234/453] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:26:43 2022] GET /identity/v3/projects/ee8652e385f24bd9be7726e25f653946 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:43.205799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:43.310503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b98776-afcc-428b-a119-6204e6b16ff1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:43.344734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:43.345609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:43.345892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:43.346161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] PATH_INFO: `/v3/groups/20190b8fcba5483793c7df8ef5fd54f3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:43.347327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] RBAC: Authorizing `identity:get_group(group_id=20190b8fcba5483793c7df8ef5fd54f3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:43.348858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7168-8c4e-4600-b69c-5dd449c700f1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:43.351010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 220/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 23 13:26:43 2022] GET /identity/v3/groups/20190b8fcba5483793c7df8ef5fd54f3 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:43.356688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b637-8711-489e-9d63-192565177269 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:43.453431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b637-8711-489e-9d63-192565177269 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:43.474958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:43.506787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:43.507472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:43.507757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:43.508037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:43.508877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] RBAC: Adding query filter params (group.id=20190b8fcba5483793c7df8ef5fd54f3, role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=ee8652e385f24bd9be7726e25f653946) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:43.509193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:43.510631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5927ba6-364b-4fd7-ac08-f16b97c81e3e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:43.516708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 235/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 23 13:26:43 2022] GET /identity/v3/role_assignments?group.id=20190b8fcba5483793c7df8ef5fd54f3&scope.project.id=ee8652e385f24bd9be7726e25f653946&role.id=77bb21c1be16493181bb82f412685ca2 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:45.853389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c44-6ee7-4b9b-8b41-5cd051290bc9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:45.853948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c44-6ee7-4b9b-8b41-5cd051290bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:45.853948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c44-6ee7-4b9b-8b41-5cd051290bc9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:45.855700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 221/456] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:45.861577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362256cd-8dc9-4140-807c-a38a8cca6d1c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:45.862093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362256cd-8dc9-4140-807c-a38a8cca6d1c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:45.862169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362256cd-8dc9-4140-807c-a38a8cca6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:45.879884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-362256cd-8dc9-4140-807c-a38a8cca6d1c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:45.881075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-362256cd-8dc9-4140-807c-a38a8cca6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:45.966393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 236/457] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:46.018253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539c44-6ee7-4b9b-8b41-5cd051290bc9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.064668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:46.192033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539c44-6ee7-4b9b-8b41-5cd051290bc9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.251076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.252159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.252447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.252720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.257446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25032-4a81-475d-aedd-52aeb110e187 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.257729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25032-4a81-475d-aedd-52aeb110e187 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.258008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25032-4a81-475d-aedd-52aeb110e187 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.263477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 237/458] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:46.264789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.264903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494993-d714-4214-ae67-04d73d2ae8e0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.265170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494993-d714-4214-ae67-04d73d2ae8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.265453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494993-d714-4214-ae67-04d73d2ae8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.266304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:46.285145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:46.286654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:46.287534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:46.287534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:46.287534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.287534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:46.287534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 222/459] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:46.301992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-92494993-d714-4214-ae67-04d73d2ae8e0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:46.302282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.303189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-92494993-d714-4214-ae67-04d73d2ae8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:46.404777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 238/460] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:46.406144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615e55-fc41-41b2-99a0-2e5d80de5532 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.406475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615e55-fc41-41b2-99a0-2e5d80de5532 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.406744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615e55-fc41-41b2-99a0-2e5d80de5532 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.408025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 239/461] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:46.420807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.421069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.421347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.441490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:46.442553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:46.442731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:46.463144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcece2-c321-440c-9f24-dd223355ff32 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.475167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:46.503464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.504131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.504408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.504678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.505410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:46.505706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.507098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.521388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 240/462] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:46.522243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.541807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 223/463] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:46.547046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.649701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a1f2-de0e-49ae-9cec-427b8170c4e8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.662079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53be02f-0d1f-4765-a40a-d2555d2167e0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.694766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.695796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.696169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.696451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.698185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.698859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.699139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.699469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.700228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.701694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.707224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.708976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.727685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 224/464] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:46 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:26:46.728721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:46.730686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:46.732628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:46.734176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:46.734176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:46.734176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.734176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:46.734443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:46.734527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 241/465] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:46.740127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.762322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:46.869216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd393db-d23a-469c-917f-2a373275022d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.881821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e105-93de-4386-8064-1e0f9776d3b7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:46.918944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.920157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.920431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.920700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.921435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:46.921739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.923459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69ed1e-553e-46fb-93ce-4642c920a1c1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.928937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:46.929943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.930227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.930501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.937486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 242/466] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:46.938837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046b5-3b8a-4dd9-b662-9613c7d185a6 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.939183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046b5-3b8a-4dd9-b662-9613c7d185a6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.939487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046b5-3b8a-4dd9-b662-9613c7d185a6 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.941268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 243/467] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:46.944180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce046b5-3b8a-4dd9-b662-9613c7d185a6 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:46.946210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:46.948995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4905e86b-148d-4276-a079-bf1aa9fede61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:46.970873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:46.972000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:46.972861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:46.972861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:46.972861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:46.972861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:46.974314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 225/468] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:46.976524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:46.976524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:46.976524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:46.994224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:46.995452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:47.045014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.050194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.069516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 226/469] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:47.070546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.075632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce046b5-3b8a-4dd9-b662-9613c7d185a6 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.130983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.132305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.132778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.133476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.134759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.136460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.163023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 244/470] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:46 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:47.172020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.223445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1bb1-faa3-42cf-b081-72574831ec91 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.300735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.301915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.302490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.302987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.303963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:47.304468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.306247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6824ec-527d-4486-bfba-ac1dcb523f11 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.322594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 227/471] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:47.324335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8994ef-bd4c-4668-a81f-305abefec559 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.324625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8994ef-bd4c-4668-a81f-305abefec559 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.324935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8994ef-bd4c-4668-a81f-305abefec559 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.326552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 228/472] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:47.328138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8994ef-bd4c-4668-a81f-305abefec559 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.355664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061472-6f2e-4915-bc8b-85fcd4f92f3e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.397235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.398042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.398484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.398900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.401222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.404206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.412920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.414399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-df82fe13-b1ea-40e9-a3dc-6e71a75d531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:47.435669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:47.436541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:47.437373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:47.437373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:47.437373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:47.437373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:47.437373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 245/473] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:47.438118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.438546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.438944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.456253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:47.457663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:47.487156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8994ef-bd4c-4668-a81f-305abefec559 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.530626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.531676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.532122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.532547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.532935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 246/474] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:47.533619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.533800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.535582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.585010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 229/475] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:47 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:26:47.585010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.717253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb2b26-4d21-4ece-bd44-74ce0697d8e3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.751523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.775286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:47.782286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf619b-2f4a-46ab-89f7-0fb6060c687d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.789678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.790392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.790679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.790952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.791726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:47.792191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.793850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.808075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 247/476] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:47.819515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.829545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.830230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.830512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.830782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.831605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:47.833017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:47.842634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.sql.core [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:26:47.842634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 13:26:47.842634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [parameters: {'id': 'd5e5a0e13d7743c49bdbabf905c0efd9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 13:26:47.842634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jun 23 13:26:47.864295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:26:47.865187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application yield resource Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise self.value Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application session.commit() Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:26:47.866077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:26:47.866946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:26:47.867858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:26:47.868678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [parameters: {'id': 'd5e5a0e13d7743c49bdbabf905c0efd9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:47.869459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 13:26:47.870225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:47.871063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 230/477] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 23 13:26:47 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:47.875270 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:47.949462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc890-4a7c-41e9-994a-f5d49d282850 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:47.995591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:47.997297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:47.997976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:47.998831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:47.999966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:48.001982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:48.006805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6634-42c7-4d1d-aa30-58e1c3f2545f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:48.039011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 248/478] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:47 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:48.066753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:48.067628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:48.067918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:48.068185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:48.085631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-482766e8-917f-48cb-ba8d-92bd157e7c86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:48.094753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:48.096842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:48.098712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 231/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:48.102897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:48.162432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:48.261562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59898e-5d87-4368-9459-b485f6a69128 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:48.305918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:48.306608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:48.306892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:48.307154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:48.307952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:48.308256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:48.309710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cc600-0653-4928-a4e0-3dec50544133 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:48.318952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 249/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:48.998918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876419-0137-4ea7-8498-3550dc26ab66 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:48.998918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876419-0137-4ea7-8498-3550dc26ab66 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:48.998918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876419-0137-4ea7-8498-3550dc26ab66 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:48.999828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 232/481] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:49.005141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.005968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.006475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.023767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:49.025248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:49.103138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 250/482] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:49.138968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876419-0137-4ea7-8498-3550dc26ab66 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:49.174092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:49.280170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876419-0137-4ea7-8498-3550dc26ab66 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:49.315446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:49.316265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.316546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.316821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.332554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e1e1bb81-2271-45be-81e1-60553253bd13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:49.344484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:49.345479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:49.346277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 233/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:49.351653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:49.411730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:49.454988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169e87-fece-484e-8aff-d7f529ffbfc8 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.455641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169e87-fece-484e-8aff-d7f529ffbfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.456112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169e87-fece-484e-8aff-d7f529ffbfc8 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.457693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 234/484] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:49.462615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.463109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.463633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.486845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:49.492527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:49.535598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cbee5-312f-4846-a76d-047a75a3d362 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:49.584125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:49.585158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.585644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.586116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.587843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:49.588514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:49.591762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:49.607249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 251/485] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:49.613205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:49.625714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 235/486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:26:49.675667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:49.694321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:49.775709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:49.802174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f369-6b03-4644-89ca-c084f7250f66 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:49.859850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e827-8163-4b10-b6a8-eb1d9d441215 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:49.874549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:49.875491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.875773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.876050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.895603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:49.896648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:49.897076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:49.897509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:49.905492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:49.907050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:49.909220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:49.917809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:49.918941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:49.920000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:49.922402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 236/487] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:49.929939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:49.938073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:49.938920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:49.939795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:49.939795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:49.939795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:49.939795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:49.939795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 252/488] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:49.952595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.019617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.049148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4999f1-9c04-4702-b70b-ca705d819144 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.086387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.087877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.088374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.088985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.089941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:50.090499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.093004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.102618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 237/489] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:50.110583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.199566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d1516-43a0-4f27-9f92-bdcf5a63d71a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.219443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595ef5-5a7a-43e5-b7bf-37f202a776df None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.255571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.256540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.256910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.263358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.271709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.281057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.282553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.287708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.288397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.288675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.288952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.289689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:50.289993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.291408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.307694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:50.315917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:50.316771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:50.317610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:50.317610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:50.317610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:50.317610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:50.317610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 238/490] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:50.323848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.326770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 253/491] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:50.332231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.476401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ed19-3be3-4e88-bbe8-5793f517442f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.488433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aee360-ecb7-486d-bf2a-108aa84eade0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.532500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.533283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.533570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.533841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.534577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:50.534988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.536670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6997-7895-48cf-b20f-a21bc3b271a7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.537798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.538602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.538885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.539161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.546565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.548046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.549898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 239/492] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:50.551310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541163e-d4c3-49d1-bdb8-c7d1d5f39b85 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.551644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541163e-d4c3-49d1-bdb8-c7d1d5f39b85 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.551922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541163e-d4c3-49d1-bdb8-c7d1d5f39b85 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.557282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 240/493] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:50.558035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541163e-d4c3-49d1-bdb8-c7d1d5f39b85 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-314cb231-4b66-488e-a624-c3070b193643 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:50.564631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:50.565531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:50.566418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 254/494] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:50.567536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.568672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.568672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.594518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:50.596163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:50.617875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.671367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.683118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541163e-d4c3-49d1-bdb8-c7d1d5f39b85 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.688105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 255/495] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:50.688990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.739859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.741057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.741369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.741652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.750066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.751574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:50.768318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:50.769276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:50.770178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 241/496] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:50.770751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.818494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47b0a-b469-4391-a715-6ea858a75246 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.852860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.853532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.853813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.854078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.854913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:50.855218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:50.856787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd806721-7d68-44ce-86ef-46fbe591988b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:50.868479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ba849-bbe5-4c3a-b360-d2e622127c14 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:50.877623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:50.893701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 256/497] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:50.895007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100d21-42c7-4d38-b72f-463dc9e3ceac None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.895263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100d21-42c7-4d38-b72f-463dc9e3ceac None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.895566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100d21-42c7-4d38-b72f-463dc9e3ceac None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.896932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 257/498] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:50.897869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1546c2-250c-44ff-b7bb-0560f64c491d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.898147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1546c2-250c-44ff-b7bb-0560f64c491d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.898417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1546c2-250c-44ff-b7bb-0560f64c491d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.899916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 258/499] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:50.900650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1546c2-250c-44ff-b7bb-0560f64c491d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.909708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:50.910513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:50.910793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:50.911063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:50.921861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:50.929801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:50.930870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:50.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 242/500] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:50.932445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:50.952513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.004577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1546c2-250c-44ff-b7bb-0560f64c491d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.028089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95a5d-2e8f-44a8-b352-6aa9669777ce None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.037970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.038647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.038930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.039207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.040079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:51.040396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.041863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea74ba-f30b-47a4-aad2-0310898d2f1c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.059315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 259/501] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:51.060536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1632-a732-4180-99a2-f027a36a42b6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.060821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1632-a732-4180-99a2-f027a36a42b6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.061099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1632-a732-4180-99a2-f027a36a42b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.061390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.062031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.062353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.062575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.076763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-65cc1632-a732-4180-99a2-f027a36a42b6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:51.077933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-65cc1632-a732-4180-99a2-f027a36a42b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:51.101880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.135843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.137379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.148021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 260/502] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:51.149309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.149592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.149861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.165066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:51.166239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:51.191926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.232880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 261/503] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:51.233710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.238796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 243/504] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:51.238796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.301900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.337049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ac7c9-40d6-42d4-8472-7f3df2d02a66 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.338760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702df4fc-6905-46a7-85b5-a6127d8d23de None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.371178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.371478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.371888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.372167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.372256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.372439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.372533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.372710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.373456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:51.373757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.375145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.383001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 262/505] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:51.383788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.413450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.441800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.443303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.484801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75f75-0637-458a-826e-3c167df57dce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.507196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.517841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.518644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.518920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.519194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.529769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.531259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.542205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 244/506] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:51.542945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:51.548127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:51.548976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:51.549802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:51.549802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:51.549802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.549802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:51.549802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 263/507] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:51.550072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.629913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.644152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608db0e4-a850-4686-bd21-a898bdbf0c9b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.652017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf1eb-8d2b-406c-b53f-21d2f7ba9571 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.677897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.678697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.678972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.679240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.686020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.686816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.687100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.687384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.689916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.691390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.697819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:51.705589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:51.706707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 264/508] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:51.707856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:51.708625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:51.709402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 245/509] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:51.710243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.733277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.811062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43166-ed6f-4fd5-92dc-aa97b5af1279 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.813056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a3f58-545a-433a-a474-c5fbff19ad99 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.847955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.848167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:51.848761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.848855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:51.849043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.849130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:51.849320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.849408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:51.857096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.860376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.861468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:51.861883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.862908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:51.879911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:51.880790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:51.886270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:51.886270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:51.886270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.886270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:51.886480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:51.887279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:51.888142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:51.888142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:51.888142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:51.888142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:51.888438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 265/510] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:51.888567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 246/511] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:51.888567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.888752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:51.960902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:51.983032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25721b-2491-4158-a9b1-5b9f32171c8e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:51.991086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020b3fd-05a5-4720-8c6f-0cac2a0bfa70 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.016764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.017461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.017745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.018024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.018755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.019060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.020481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.024067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.024726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.025003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.025271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.026018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.026316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.027702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.032075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 266/512] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.032893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.036266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 247/513] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.037250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.085287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.136582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2c08-06af-4e4b-9c52-3a5f1f2d1430 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.137648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ae5a-185a-406e-a906-165ad246bfc0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.170462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.170629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.171131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.171227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.171434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.171543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.171711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.171800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.172422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.172519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.172731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.172818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.174090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.174177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.175580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.186563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 267/514] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.187378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.187832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 248/515] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.188903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.283492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a776e-8e2a-478c-8827-886eaab2149a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.286883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205da9-3592-45b9-944a-7ec93854ccd2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.293946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.317383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.318066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.318347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.318621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.319354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.319673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.321057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.321497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.322178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.322469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.322743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.323490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.325029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.332651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 268/516] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.333460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.346839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 249/517] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:26:52 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:26:52.347889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.408418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.447918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09084-44bf-4671-b4b4-d107189c4ad5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.469382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96a61-fbe6-42cc-8291-54f28a3f6001 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.485138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.485962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.486241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.486515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.498970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.500396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.509935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.511049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.511049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.511328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:52.518590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:52.519449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:52.520729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:52.520729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:52.520729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:52.520729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:52.521164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.521247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 269/518] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:52.521315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.521389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:52.539678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:52.540612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 250/519] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:52.542319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.549494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.627361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f572-eb53-48e9-a9da-6eedcbbc9bab None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.652517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc1c4-d607-46d0-9cea-4f6d62c82d0c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.663256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.664213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.664320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.664576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.666162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.674008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.675512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:52.693677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:52.694617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:26:52.695528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:52.696061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.696061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.696061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.696061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.696738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 270/520] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:52.697519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.709473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.710968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:52.725932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:52.726975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:52.728002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:52.731763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 251/521] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:52.732583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.797587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.818652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300137f-f7c6-4af2-ac12-10add97e5e45 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.844007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365ae2-f743-440f-a3cb-d2e034f12581 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:52.856185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.857001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.857400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.857767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.858699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.859196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.860691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.877581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 271/522] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.877581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.884021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:52.884692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:52.885058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:52.885340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:52.886125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:52.886432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:52.887976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:52.910379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 252/523] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:52.910379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:52.938293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:52.991253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d71745-6f1e-482c-b334-24a4d0fda2ef None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.014334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba25a-a0f1-46d7-b458-b67ebf441d71 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.025535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.026320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.026667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.027028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.028053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:53.028431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.030000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.045729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.055122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 272/524] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:53.055999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.056863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.057532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.057815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.058090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.059094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:53.060207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.061682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.074023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 253/525] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:53.074931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.170384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2457f-51cc-4b9c-b0b9-bf49d41b893f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.174467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.184309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7510-8e14-4925-942b-55b45a0aaf00 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.204421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.205179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.205458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.206126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.213375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.214947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.219901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.220820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.221270 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.221707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.222788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:53.223247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.224846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:53.229665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:53.230829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:53.231831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 273/526] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:53.232381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.233407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 254/527] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:53.234303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.324795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.355117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f486-3bff-414f-9cea-acd0f1635a04 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.388676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b8af-4544-4ff7-b576-b6575cff9def None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.394564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.395224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.395558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.395828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.396669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=332b8759a3e8491a8a1319ce68e1d62c) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:53.396969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.398673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.404683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 255/528] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/role_assignments?user.id=332b8759a3e8491a8a1319ce68e1d62c&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:53.405308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.427929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.439589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.439589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.439589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.439589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.568298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.569698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.585599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36d3e-d1c4-441f-9375-1aecfab24ec3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.637482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.650958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.651990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.652342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.652681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.654628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:53.655004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.656611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.707736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 274/529] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:53.711978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.727349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 256/530] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:53.732535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:53.851970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0670-31ac-473f-ae6a-6729e563a0ff None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.879725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:53.903556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633a19-15c0-4d0d-8804-ab8c02aed9c0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:53.927398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.928238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.928517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.928791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.942624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:53.943486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:53.943870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:53.944240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:53.953941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:53.955763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:53.994640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:53.995814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:53.996928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:53.996928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:53.996928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:53.996928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:54.000749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 275/531] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:54.003870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.021541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.074224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.076023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.114278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd731d98-0555-44ad-9837-f012b2549a91 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.151595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.152269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.152550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.152888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.153617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:54.153921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.155315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.168284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 276/532] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:54.173239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.258930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.313005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 257/533] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:26:54.318787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.328550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb32fa-76ca-49b2-aac9-be7d223cd926 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.347719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.365231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.365405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.365633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.365900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.373006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.374494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:54.389174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:54.390041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:54.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:54.395114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 277/534] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:54.396453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.499250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8893a-e6e6-44bf-ac1e-6ccc66a8c543 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.535368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.538635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.539318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.539776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.540054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.540846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:54.542503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.544046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3ea1-cef6-490a-95e3-c4d2b4b8d12b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.570897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 278/535] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:54.572515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba46da-aa3b-400d-962c-a0ce2d448769 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.572811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba46da-aa3b-400d-962c-a0ce2d448769 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.573088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba46da-aa3b-400d-962c-a0ce2d448769 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.574994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 279/536] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:54.575536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1bf73-bb45-49a4-ada8-16f82b45d1ad None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.575983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba46da-aa3b-400d-962c-a0ce2d448769 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.615648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.616378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.616662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.616938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.627629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.629226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b8359d63-196f-486c-8ae1-64885835c977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:54.647212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:54.648098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:54.648939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:54.648939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:54.648939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:54.648939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:54.648939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 258/537] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:54.652464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.652464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.652464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.667742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:54.669095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:54.691505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba46da-aa3b-400d-962c-a0ce2d448769 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.698294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.734050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.734971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.735259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.735557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.736577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=e47a97beb009467b9b53222ba5a551fc) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:54.737015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.739022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:54.751364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 280/538] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/role_assignments?user.id=e47a97beb009467b9b53222ba5a551fc&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:54.751364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.761250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 259/539] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:54.794657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:54.855535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:54.935436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c947f-2420-4e3a-b189-7975973ccef2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.964512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd683-a205-45e5-90c8-1d4735e91124 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:54.984346 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:54.985501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:54.986716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:54.988508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:54.989452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:54.990140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:54.992405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.014196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 281/540] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:55.019984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.024984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.026052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.026733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.027948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.047003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:55.056592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:55.057470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:55.058290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:55.069084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 260/541] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:26:55.076496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.111676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.205427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9cd21-fc39-4b7a-9721-8f0e92a80e38 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.230747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.254529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.255655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.255934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.256347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.264061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.265960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.268521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91e491-2978-4bb4-952f-e4c24d7f491f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:55.281840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:55.282718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:55.284198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 282/542] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:55.289588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.341812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.342500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.342778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.343051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.343835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:55.344135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.345542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.372296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 261/543] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:26:55.373195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.464490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b22b16-325e-4d50-a62f-a42a76562638 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.495291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.503378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.504152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.504436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.504710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.505500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:55.505809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.507371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46cf7b-54fb-424f-a9eb-334ce5457aa2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.517792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5ba2-88e8-45c2-a564-15b5d8e366c7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.525639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 283/544] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:55.527040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e145-6c86-4528-a9c9-dcad77a8aadf None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.527465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e145-6c86-4528-a9c9-dcad77a8aadf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.527817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e145-6c86-4528-a9c9-dcad77a8aadf None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.529461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 284/545] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:55.530171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535e145-6c86-4528-a9c9-dcad77a8aadf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.556231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.557574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.557856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.558263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.572766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.574287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.574978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7009a051-2e70-47b5-b5bf-6aff72809379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:55.594811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:55.596049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 262/546] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:55.598035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.598754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.598754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.616496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:55.617691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:55.653862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535e145-6c86-4528-a9c9-dcad77a8aadf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.693216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.694457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.694742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.695018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.695899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=ffb912f209ff452583ce16ca36ae1967) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:55.696208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.697657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.697935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 263/547] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:55.698783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.708919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 285/548] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/role_assignments?user.id=ffb912f209ff452583ce16ca36ae1967&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:55.747893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.795142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.842417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a57f12-650d-42df-b32d-2b17a10a072b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.862730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f9666-aea8-4e87-b6e3-7dade8f5b5bb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:55.876023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:55.883511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca0889-e874-44f0-b943-493536ae989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.884189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0889-e874-44f0-b943-493536ae989a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.884471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0889-e874-44f0-b943-493536ae989a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.884864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0889-e874-44f0-b943-493536ae989a None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.885614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca0889-e874-44f0-b943-493536ae989a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:55.885919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca0889-e874-44f0-b943-493536ae989a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:55.887445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca0889-e874-44f0-b943-493536ae989a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:55.900030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 264/549] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:55.901397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ffe-016c-450c-ac91-8a7f52a5dd08 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.901686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ffe-016c-450c-ac91-8a7f52a5dd08 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.901964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ffe-016c-450c-ac91-8a7f52a5dd08 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.903290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:55.903569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 265/550] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:55.904107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.904386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.904657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.905538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9ffe-016c-450c-ac91-8a7f52a5dd08 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:55.916914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d11f09da-6b40-4810-ab76-35cfde86d794 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:55.927546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:55.929153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 286/551] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:55.930891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:55.932373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:55.932373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:55.953669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:55.954849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:56.024579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9ffe-016c-450c-ac91-8a7f52a5dd08 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.039485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 287/552] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:56.040517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.055777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.064378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.065580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.066062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.066539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.075415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.077205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:56.099137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:56.100137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:26:56.101231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:56.109894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 266/553] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:26:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:56.110991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.147633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.157304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61aca5-e33c-45c2-aabc-0f726379d9f5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.196167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.196624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.196905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.197184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.197935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:56.198239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.199730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.208492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 288/554] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:56.209316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.225383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0926e2-4383-403d-92f7-3d4356008d5a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.262276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.263509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.263993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.264457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.276259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:56.284879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:56.285879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:56.286700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:56.289427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 267/555] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:56.290453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.314275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775231b-96e2-4c46-a168-094cc8bd9eee None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.338070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.348583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.349257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.349536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.349807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.350648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:56.350957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.352436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.369847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 289/556] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:56.371241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.382612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.404776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d8ac-b33d-4e9f-b45c-11ff9630a093 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.441454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.442668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.443177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.443669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.461005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.462482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.478661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed413e1d-a611-4d7f-8ce7-d831043b44ce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:56.487160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:56.488570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:56.489456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:56.489456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:56.489456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:56.489456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:56.492215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 268/557] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:56.493521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.527601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.528808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.529256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.529694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.530844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:56.532222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.533793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.545143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 290/558] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:56.546136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.597311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.604205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3d255-6674-4ea4-a6bc-8be09083d359 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.624640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.639279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.640152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.640535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.640908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.659452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3c9f7-aab0-4e8d-81e4-36d2e2bce1a6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.695546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.696492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.696970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.697476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.698468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:56.698946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.700589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.713579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.714117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 291/559] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:56.715200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.716067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.813870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.821137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 269/560] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:26:56.822183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.824300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdb23-93ec-4d33-934c-0deedf580827 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.857664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:56.864093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.865240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.865797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.866309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.879956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.881978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:56.901997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:56.903026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:56.903955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:56.903955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:56.903955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:56.903955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:56.906296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 292/561] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:56.907275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:56.932803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6bbd9-ca22-4594-8cda-b6b4dd7d6062 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:56.968000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:56.968804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:56.969084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:56.969355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:56.976452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:56.977930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:56.992337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:56.993515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 270/562] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:56.994457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.017969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f80-69ee-417c-a0e0-12be615e1d9a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.050247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.057777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.058728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.059084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.059390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.069455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.070852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-dfe7c28d-44fe-4c65-af70-3a19dd6346c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:57.089414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:57.090374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:57.091594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:57.091594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:57.091594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:57.091594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:57.095521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 293/563] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:57.096836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5ae6-60cf-4d98-b508-b48ccecdfe79 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.097118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5ae6-60cf-4d98-b508-b48ccecdfe79 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.097393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5ae6-60cf-4d98-b508-b48ccecdfe79 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.098889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 294/564] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:57.099606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5ae6-60cf-4d98-b508-b48ccecdfe79 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.107770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c35d-36b2-4622-901a-74cc301bcbc2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.137981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.148269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.148935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.149217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.149490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.150219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.150522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.151950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.163670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 271/565] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:57.164369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.211859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5ae6-60cf-4d98-b508-b48ccecdfe79 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.246993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.247701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.247979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.248250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.249088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.249398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.250830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dfcbf-b409-4b59-b03d-bb93481385d4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.268720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 295/566] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:57.269105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c0-c49b-40c6-9f57-f160bc6c0010 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.274137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.274429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.274713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.283528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.292664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:57.293900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:57.303634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.304300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.304582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.304856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.305586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.305892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.307275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.324035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 272/567] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:57.324035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.379382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 296/568] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:57.379382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.397597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.437348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eba134-568c-4138-aeee-ec89f3707068 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.472223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.473032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.473322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.473596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.476212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ab8f-625d-43e7-90fa-0acf57721c48 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.482561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.484060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:57.498890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:57.499912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 273/569] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:57.500864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.516130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.516917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.517217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.517490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.527994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.529944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.536101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:57.549552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:57.550493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 297/570] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:57.552108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.614064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab40e-45ac-4a1f-916e-be8a21fe6160 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.633724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.657859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.658667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.658867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ec2a-d198-4fc3-b836-ff6c04c8554a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.658971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.659207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.667125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.668670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:57.683384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:57.684360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:57.685239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 274/571] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:57.685748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.698990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.699873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.700151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.700422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.710782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:57.718908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:57.719901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:57.720768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 298/572] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:57.721453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.789807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.796722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc8f4-548e-481e-b9b0-ecc7ebc53575 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.824040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb863-c52f-4cde-a3ae-8cecd214f3e1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.830785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.831481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.831762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.832033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.832867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.833173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.834607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.851955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 275/573] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:57.852729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.862397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.863505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.863800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.864429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.865109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.865419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.866802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:57.869295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:57.879946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 299/574] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:57.880726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:57.954054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804b19-153b-4260-8bd8-7f4de2aab156 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.976622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0068e-0673-4fe3-8b9b-b57229311f6e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:57.987605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:57.988269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:57.988549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:57.988825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:57.989599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:57.989908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:57.991369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0556-e31a-4897-8650-bfbcb27c6516 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.002619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 276/575] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.003836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a115-5f89-49e4-8022-713c15eba6f6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.004126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a115-5f89-49e4-8022-713c15eba6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.004408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a115-5f89-49e4-8022-713c15eba6f6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.005899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 277/576] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:26:58.006600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579a115-5f89-49e4-8022-713c15eba6f6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.014017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.014751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.015038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.015297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.016097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:58.016425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.017787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.021268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.025962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 300/577] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.026728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.082969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.111081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579a115-5f89-49e4-8022-713c15eba6f6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.129656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d8d35-a6f3-47ba-af50-318d0bef669d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.144191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.145017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.145287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.145567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.155825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.157282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.161725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.162523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.162801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.163072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.169805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.171229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:58.174322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:58.175177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:58.176123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:58.176123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:58.176123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:58.176123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:58.176123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 278/578] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:58.176400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7d097e81-a73f-4d64-85f5-8d48f163db12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:58.185429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:58.186312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:58.187196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 301/579] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:58.188270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.188270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.188532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.204462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:26:58.205663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:58.244331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.270302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 302/580] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:26:58.270954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.282378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227ec-e9b3-4037-8768-8fb845501006 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.316473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.317128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.317451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.317728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.318148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.318543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=c2660c54018042e5af8535a2b7b5e9af) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:58.318860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.320593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.326263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 279/581] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/role_assignments?user.id=c2660c54018042e5af8535a2b7b5e9af&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.327035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.375701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acfc5c-ee24-4cd2-9f0b-ddb383d92036 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.414907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.415751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.416032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.416305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.427744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.429220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:58.447909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:58.448913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:58.449883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:58.449883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:58.449883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:58.449883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:58.449883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 303/582] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:58.450191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.457082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587180f-a545-4a12-8cc9-12e163473d12 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.487719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.496589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.497265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.497547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.497821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.498556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:58.498857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.500272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.516614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 280/583] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.516614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.555522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.558556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2553de-bfa9-49cc-90ec-c7a396a9b62d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.595316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.596770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.597055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.597332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.598117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:58.598425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.599878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.617876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 304/584] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.617876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.626817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328728e-c242-4250-9ee4-40ac6e77514e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.663218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.664096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.664380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.664653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.677975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:26:58.686812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:58.687789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:58.688650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 281/585] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:58.689768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.726901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21877dc-506c-4865-ba73-65b5d1ba4ac1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.741704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.767180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.767897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.768180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.768450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.769594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:58.771384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.771669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.790086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 305/586] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:58.790929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.797153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014ab7-07b9-4d60-942d-108a92e6e857 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.814232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.833516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.834330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.834612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.834887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.842233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.843717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:26:58.858220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:58.859126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:26:58.860094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:58.864117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 282/587] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:58.864772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:58.904366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451d9e-a478-4a5c-8e74-95b8e9d2c4af None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.943210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:58.944085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:58.944490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:58.944778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:58.961268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=db1031b48c8142508bd94fe89142a9ef, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:58.962774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:58.964330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8937fb0-4458-4295-8aa9-d35825b8dd7d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:58.975047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:58.991374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 306/588] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:58 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:58.991374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.022005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.023025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.023425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.023766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.024695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:59.025062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.026536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.037124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 283/589] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:59.038381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.109124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.145718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8444d-4616-4106-adc6-3678701c8127 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.167964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632613a-e110-4dd3-a9bd-a9efceeecf70 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.181626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.182429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.182709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.182984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.190972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.192451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:59.206814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:59.207785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 307/590] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:26:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:59.209112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.213060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.214064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.214541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.215026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.216730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:59.218184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.219987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.238297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 284/591] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:59.239665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.283240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.323022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6115ff-9d57-43b6-b8b8-c227249772d6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.353286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.360192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.361116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.361480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.361837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.373318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.374895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.378571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890a56-afab-45c1-9078-a7eb8e7f0fd8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:59.396871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:59.397799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 308/592] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:59.398951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.426376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.427384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.428476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.428917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.430251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:59.431019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.433594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.454165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 285/593] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:59.455063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.521099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe103-4dec-4bba-8120-3f18f0d42bb9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.559435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.562477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.563564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.563855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.564131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/332b8759a3e8491a8a1319ce68e1d62c/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.574712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38beb0-884c-4413-b24f-e8b56eca0957 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.580269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=332b8759a3e8491a8a1319ce68e1d62c, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.581768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.597495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 309/594] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:26:59 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/332b8759a3e8491a8a1319ce68e1d62c/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:26:59.598921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.615805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.616962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.617529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.618086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.619151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:26:59.619739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.621659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.637357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 286/595] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:26:59.638615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.652635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.749130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74393a-08ff-491e-a8fe-96cc49e67f6f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.792109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.793317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.793866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.794147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.807946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.809466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:26:59.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:59.835237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:59.836154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:26:59.836154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:26:59.836154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:26:59.836154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:26:59.836788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 310/596] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:59.841879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aecff-b471-4bf0-8dda-3a9337be00a9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.844171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.903196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:59.904491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:59.905079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:59.905549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:59.923084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:59.924997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:59.931844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:59.950463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c1d6-bab8-4a86-a262-b93307dc583e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:26:59.960586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:26:59.961547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:26:59.962500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:26:59.965923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 287/597] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:26:59.972813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:59.993904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:00.000942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.001830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.002256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.002675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.003645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:00.004215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.005775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.018671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 311/598] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:00.026259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.155959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5596dc-26ac-48f9-952d-0ad0d0203f40 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.196992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b160d-2344-4ef9-83f4-38f66b6348cf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.235624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.236162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.236961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.237241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.237515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.237746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.238229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.238400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:00.238683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.239081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.240213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.247586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.249417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:00.264671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:00.265628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:00.266539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:00.269127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 312/599] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:00.272493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 288/600] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 23 13:26:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:00.277146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.280410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.284769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:00.407715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:00.438534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38a81-3631-4957-8a03-ee7619a2e2d5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.466502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449322e-a18f-4b6c-bbbc-0367830be123 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.500227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.500893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.501379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.501495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.502278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:00.502582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.504035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4c2e-5bd6-4a6d-8d9b-817ddadf620d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.522573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 313/601] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:00.522573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341bca-4510-47f2-b84f-e0a38223c147 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.522573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341bca-4510-47f2-b84f-e0a38223c147 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.522573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341bca-4510-47f2-b84f-e0a38223c147 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.524099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.524904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.525180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.525449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.526362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 314/602] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:00.527039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341bca-4510-47f2-b84f-e0a38223c147 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.541568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.543698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1bf6a36d-72b6-4d2c-8982-f2f342206ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:00.563929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:00.564871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:00.565767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:00.565767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:00.565767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:00.565767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:00.565767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 289/603] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:00.571483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.571892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.572294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.589471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:00.591102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:00.618015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:00.671435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 290/604] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:00.671435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.682163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341bca-4510-47f2-b84f-e0a38223c147 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.729162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.730106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.730384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.730703 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/e47a97beb009467b9b53222ba5a551fc/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.735252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:00.753773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=e47a97beb009467b9b53222ba5a551fc, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.756162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.782601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 315/605] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:00 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/e47a97beb009467b9b53222ba5a551fc/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:00.782601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.832747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac66ac-afe0-4b29-b628-d094204f883a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:00.920661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:00.921344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:00.921675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:00.924746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:00.925602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:00.925918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:00.927648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:00.954386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 291/606] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:00.963631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:00.993147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95275b69-bf17-4c6f-a90b-35c042c6cb64 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.013715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.045660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.045660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.045660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.046119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.058377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:01.068713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:01.075682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:01.076548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 316/607] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:01.080928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.119800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828fbe-53df-42b0-bd29-f4a8a5a61434 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.135664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.189907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.190640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.190923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.191198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.208397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.209898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:01.235035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:01.236183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:01.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 292/608] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:01.242050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.253490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54d6f-8223-46bf-8ee7-abe62719ef41 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.288108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.289166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.289900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.290598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.291883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:01.292381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.294045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e433716-11c3-4e04-b5a6-25d904a7f37f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.302971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 317/609] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:01.304553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988660d5-5816-4fb1-bdba-cb9fe32a8e62 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.305069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988660d5-5816-4fb1-bdba-cb9fe32a8e62 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.305554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988660d5-5816-4fb1-bdba-cb9fe32a8e62 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.307283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 318/610] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:01.308192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988660d5-5816-4fb1-bdba-cb9fe32a8e62 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.351401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.391879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6c09-3d41-4284-866e-74536b097fc8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.428242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.429328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.429857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.430352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.431382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:01.431884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.433524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b1f77-13a5-4331-b3f2-dcd4b59d4976 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.437926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988660d5-5816-4fb1-bdba-cb9fe32a8e62 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.451669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 293/611] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:01.452978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.453266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.453555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.471976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:01.473171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:01.479150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.480007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.480289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.480564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.495272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.497246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.497729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:01.519231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:01.520419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:01.521612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:01.521612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:01.521612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:01.521612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:01.525203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 319/612] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:01.526033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.573075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 294/613] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:01.573075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.632513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.646473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e52b-ef42-4033-935d-6727c80aea37 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.681732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.683043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.683043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.683260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/ffb912f209ff452583ce16ca36ae1967/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.698877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=ffb912f209ff452583ce16ca36ae1967, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.700644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.714229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904fe34-980c-4369-a211-a07d1d38faec None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.727560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 320/614] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:01 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/ffb912f209ff452583ce16ca36ae1967/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:01.727560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.794267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.794958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.795241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.795621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.796371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:01.796679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:01.798252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:01.811600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 295/615] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:01.817328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:01.839721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.926312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84744-3c63-44dd-9881-cc8fea11b9f2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.965513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:01.966622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:01.966905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:01.967171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:01.970820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d25db-51f4-45e1-b78c-e6c8551ebe94 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:01.976716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:01.980562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3200056a-d0af-44ce-8fe9-aacdb518e5eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:01.994185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:01.995416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:01.996516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:01.999445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 321/616] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.000905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5574-8230-49a4-98c4-90aa9b6fee65 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.001335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5574-8230-49a4-98c4-90aa9b6fee65 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.001738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5574-8230-49a4-98c4-90aa9b6fee65 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.003462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 322/617] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:02.008515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5574-8230-49a4-98c4-90aa9b6fee65 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.022693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.024142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.024546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.024912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.035067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.036706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a095100d-b618-4b06-a593-ed5675c3c82d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:02.054839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:02.056056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:02.057217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:02.059991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 296/618] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.064524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.064524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.064524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.083732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:02.085327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:02.133650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5574-8230-49a4-98c4-90aa9b6fee65 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.168360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.169193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.169580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.169960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.170818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:02.171243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.172777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.173714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 297/619] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:02.180285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.186806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 323/620] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:02.187815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.195505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.263089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.308363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac332c-7d5e-4abe-9b9a-2ec6e74637c0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.317816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3c34-524d-461e-9ff0-62eb6e2a219f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.345534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.346386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.346774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.347150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.348124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:02.348537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.350081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.362134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.363294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.363739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.364155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.372399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 298/621] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:02.372399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.380082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.381563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:02.400367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:02.401261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:02.402167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:02.402167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:02.402167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:02.402167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:02.406249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 324/622] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.407237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.447029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.497439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e792-5c02-43cc-9684-786d99b5475b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.520059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cfd9-64f1-45b0-9f3d-9967c43cf004 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.535557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.541245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.542220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.542508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.543032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.554489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:02.562343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:02.562829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:02.564151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:02.565038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:02.567576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.568075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.568566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.568853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 299/623] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.569697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.582402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.584873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:02.606958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:02.607916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:02.608809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:02.608809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:02.608809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:02.608809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:02.615806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 325/624] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.617525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.688579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab915-cbbf-4061-8987-8fc2a85cd30e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.716548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.721683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aebf0-1b47-40d2-bbb1-4f3a556d7cd7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.728460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.729336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.729792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.730314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.731379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:02.731912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.733624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.751478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 300/625] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:02.752834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.757719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.758008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.758294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.758566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.759318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:02.759644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.761018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.770382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 326/626] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:02.771587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.799376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:02.872900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdcda-fdec-48ec-8984-157fe036d670 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.874451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89401c3d-1d27-4bad-b9be-59221d88d0e2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:02.907447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.908444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.908576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.908802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.914259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:02.915380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:02.915911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:02.916402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:02.917380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:02.917910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.918228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:02.919851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.920369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:02.934201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 301/627] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:02.935395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:02.939474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:02.940468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 327/628] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:02.942469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:02.995625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.035619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.050736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d288-70b3-4b02-9717-9dd314e29b85 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.053857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6daa0-01d7-4e29-8d78-8a9c07820f1a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.084634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.085434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.085701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.086068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.089188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.090052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.090332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.090916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.096619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.098270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.104220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.105919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:03.116978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:03.117890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:03.118764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 328/629] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:03.119774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5d2b61ce-db9e-46b4-aa6b-a5c03d65a7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:03.128309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:03.129402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:03.130493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:03.130493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:03.130493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:03.130493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:03.135726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 302/630] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:03.135726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658671-27b3-4118-94ae-a12d8fe8eff4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.135726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658671-27b3-4118-94ae-a12d8fe8eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.135726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658671-27b3-4118-94ae-a12d8fe8eff4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.138719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 303/631] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:03.139525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658671-27b3-4118-94ae-a12d8fe8eff4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.233793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532518d-9ee2-4e62-8ee3-e3b999172f57 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.238214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.243569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658671-27b3-4118-94ae-a12d8fe8eff4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.269648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.270323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.270611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.270886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.271753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:03.272066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.273592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.279245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.279936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.280221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.280492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.281280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:03.281593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.283046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25de5bc-d56b-491f-a390-db2055db9e26 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.292034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 329/632] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:03.293420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.298977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.300327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 304/633] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:03.306337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.306880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.306880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.322675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:03.324032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:03.392556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 305/634] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:03.393745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.408403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82699a1-c733-404e-bade-2a738de00bce None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.444962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.445681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.445965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.446241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.447042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:03.447371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.448754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.460823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 330/635] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:03.466104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.499888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.513568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b2cce-343d-4d4c-a4d9-44612bcc2c3c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.530091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.550384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.550975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.551288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.551614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.571459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0200c-b2fe-4627-b3b7-2f57d4633af1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.608971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.609866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.610375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.610491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/c2660c54018042e5af8535a2b7b5e9af/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.622699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.624244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.628025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=c2660c54018042e5af8535a2b7b5e9af, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.629487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.651372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 331/636] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:03 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/c2660c54018042e5af8535a2b7b5e9af/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:03.651372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.740572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.757339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 306/637] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:03.758272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.779974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6a20-d958-4fef-ab68-f5d833469b85 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.796085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:03.824668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.825412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.825697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.825969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.837801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:03.846307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:03.847281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:03.848252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 332/638] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:03.849032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.884190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554c10-91f9-44ff-bae1-ff6fc2a0878a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:03.920252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:03.921123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.921404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.921674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.931413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:03.932880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-60af2622-d5bd-4b92-b384-58bc037c67ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:03.947602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:03.948542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:03.949486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 307/639] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:03.950114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28e63-8c62-438f-a46b-823a1cf70508 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:03.950814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28e63-8c62-438f-a46b-823a1cf70508 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:03.950814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28e63-8c62-438f-a46b-823a1cf70508 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:03.956094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 308/640] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:03.956949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28e63-8c62-438f-a46b-823a1cf70508 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:03.973101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6561f-cdc1-4fb7-995d-1b6f1c5f178b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.008743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.009299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.009564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.009919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.011829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.021309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.022782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:04.040488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:04.041446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:04.042335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:04.042335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:04.042335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:04.042335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:04.042335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 333/641] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:04.042623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.068630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28e63-8c62-438f-a46b-823a1cf70508 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.073995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.116890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.119448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.119448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.119448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.119866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:04.120078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.121544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16117aa-c8f8-4cc0-8309-00427dedbf27 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.131947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 309/642] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:04.133993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.134442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.134863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.155542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:04.156332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36a23-2e51-4bbe-aa81-1c6114980337 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.156941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:04.190445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.191239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.191648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.192031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.193063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:04.194017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.194975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.219308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 334/643] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:04.219308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.230836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 310/644] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:04.235698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.288809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.316076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.334560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24887-9895-48db-a923-b507981712d8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.347716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37c73-327b-4b4b-b392-e1291121ee27 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.374474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.375146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.375374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.375646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.376423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:04.376672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.378042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.383399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.384200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.384928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.385207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.393466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 335/645] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:04.393466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.398041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.399615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:04.420472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:04.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:04.422497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:04.422497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:04.422497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:04.422497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:04.422497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 311/646] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:04.424053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.500335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01d7b-a3c4-4938-8410-893a74f76f42 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.514986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.525171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2b88-ddbd-4178-b04f-78b577bc6d10 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.537513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.538318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.538698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.539129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.555840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.562186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.563109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.563544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.564324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.574881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:04.582839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:04.583982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 312/647] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:04.590181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.620227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.621824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.691085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccd7b-0004-468a-97b0-8a92a0fda8cf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.724122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 336/648] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:04.724975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.733935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.734993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.735281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.735590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.742618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.744119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:04.758817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:04.759841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:04.760783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 313/649] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:04.761272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.778071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.781450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:04.838410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141f39-d8fe-4940-899e-13836c967ebe None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.869223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642ebe-a157-4d17-b435-0ed161f1ff34 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:04.876072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.877156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.877437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.877715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.878787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:04.879100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.880821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.893206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 337/650] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:04.894030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:04.912317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:04.913005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:04.913288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:04.913565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:04.914316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:04.914626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:04.916054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:04.924510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 314/651] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:04.925278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.002750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.005584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251b3a4-3f5c-45e4-9a3e-2f122cdc986a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.008728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.027990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970deeb5-6f91-4199-9c05-76874bc7c444 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.042430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.043278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.043585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.043951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.054799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.056506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.061053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.061711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.061990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.062266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.063043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.063355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.064801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:05.074939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:05.075868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:05.082172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:05.082172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:05.082172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:05.082172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:05.082395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 315/652] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.082548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 338/653] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:05.082548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.082693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.187449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7353fa-2c6c-49e7-8bb0-c8e1cbbef32f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.189851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bf3c1-cf7f-494b-bf6a-5f5fb61ee8a8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.224219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.225117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.225217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.225413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.225682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.225973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.226256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.226532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.228029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.235331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.236838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.238044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.239502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:05.252503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:05.253503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:27:05.254459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:05.257034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:05.257903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:05.264807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:05.264807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:05.264807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:05.264807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:05.264807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 339/655] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:05.265147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 316/655] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:05.265243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.265327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.272829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.367027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970a8c-4807-46d4-9e9d-8b069c9a5ff4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.368938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ed70-210d-49a8-b2ae-3bee1e0187e6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.403836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.404643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.404790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.404986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.405202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.405313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.405590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.405865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.405960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.406212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.406683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.406990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.407617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.408433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.414422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 340/656] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.415106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.425832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 317/657] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.427702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.497793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.513053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.552120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4584-3194-41a2-9f81-97766beae715 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.561627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d41adc-1abe-412d-b013-0bc1d0873bfb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.595393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.596507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.596798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.597081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.597913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.598227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.598420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.599092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.599403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.599695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.599818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.600496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.600805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.602451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.613298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 318/658] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.613789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.626354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 341/659] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.627056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.732699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277bb4-0e40-4db2-9a0d-a397937f0184 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.738585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235157b0-89b6-4fdf-8f48-e13c72ee9688 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.749461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.766505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:05.772619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.772913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.773429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.773710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.773805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.773983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.774086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.774246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.781514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.782065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.782956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.783054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:05.797357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:05.798245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:05.799135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-1f2b52c3-72d8-4c96-8403-b8fda810c4d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:05.800091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:05.800970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:27:05.801890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:05.802512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 319/660] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:05.802512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.803718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 342/661] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:05.804921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe63d-8a68-4dea-8296-0cd7cdb7a8cb None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.805208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe63d-8a68-4dea-8296-0cd7cdb7a8cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.805484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe63d-8a68-4dea-8296-0cd7cdb7a8cb None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.810352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 343/662] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:05.810352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe63d-8a68-4dea-8296-0cd7cdb7a8cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.912201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ed87-b2c4-443d-b0b7-d635d68b1cd5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.926504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe63d-8a68-4dea-8296-0cd7cdb7a8cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:05.948643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.949329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.949641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.949916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.962597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:05.963255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:05.963633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:05.963903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:05.964616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:05.964990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:05.966741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:05.984448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 344/663] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:05.984448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:05.996543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.020448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.022646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588848-4fba-4ceb-b0a2-ffb6acdf674b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.035705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.086545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329d2f0-b32d-40dd-bb72-656b295e7163 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.128049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.128729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.129013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.133617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.133746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 320/664] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:06.133827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:06.133827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.133974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.133974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.133974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.134165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.148367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:06.149585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:06.156126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 345/665] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 23 13:27:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:06.156126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.235592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 321/666] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:06.235592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.241582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.277026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bcb1-5485-46d2-bbe2-b8967c179020 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.287991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.318147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.318802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.319080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.319373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.320207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=332b8759a3e8491a8a1319ce68e1d62c) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:06.320547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.322454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.329088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 346/667] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/role_assignments?user.id=332b8759a3e8491a8a1319ce68e1d62c&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:06.329839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.363238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c437fb-6e23-4f99-9cec-087bdec9fd50 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.411161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.412208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.412490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.412761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.427897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.430253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:06.453625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:06.454634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:06.455559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:06.455559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:06.455559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:06.455559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:06.459825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 322/668] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:06.460795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.469803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327e64-fc6b-4122-9a97-6e6a9cdd5820 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.515497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.516491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.517682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.518145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.532378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.563916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.592511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52966-8eaa-4b32-82f2-a9a2e862687b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.596020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.597475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.635494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.636415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.636750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.637036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.651824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:06.662623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:06.663616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:06.664454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:06.665084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 323/669] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:06.665802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.717515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 347/670] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:06.718382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.797588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.800506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa31d-f5ff-4681-ab93-a93f541d1cbe None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.824491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:06.841955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1348f6-b8f2-40c8-a819-c351971cb9dd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:06.842999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.843693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.843980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.844255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.844981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:06.845287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.846677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.863200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 324/671] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:06.863200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.891698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:06.892957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:06.893664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:06.894520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:06.895753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:06.896270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:06.898899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:06.911552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 348/672] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:06.912657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:06.982676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347df3-d40a-45ff-b73f-2cb762ad2acc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.027247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.028122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.028407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.028687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.037458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350e46-9718-4987-b3d6-aee4e7553d47 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.041690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.043211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:07.065470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:07.066474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:07.067396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:07.067396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:07.067396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:07.067396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:07.071362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 325/673] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:07.072563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.081555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.083263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.083775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.084696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.087559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.102127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.104606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.110664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:07.125938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:07.126916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:07.127856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:07.128285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 349/674] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:07.131357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.201254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1c9aa-c734-4eef-9410-7ea4c3179554 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.233010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145583a-7c8d-49f0-89cf-ebf57684620e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.238487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.239388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.239672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.239944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.251462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.252937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.267408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.268074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.268355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.268632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.269359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:07.269665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.271042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:07.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:07.274232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 326/675] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:07.276305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.291549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 350/676] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:07.292433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.347414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.363259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.384013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3a4e3-0d8d-44ff-a6a0-69feb27eabbc None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.394980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea57e2-471f-4338-a512-d2401fe5884d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.420513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.421267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.421550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.421827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.422801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:07.423204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.424778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.428765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.429430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.429710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.429988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.430708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:07.431014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.432421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.442924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 327/677] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:07.443851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.449742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 351/678] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:07.450672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.550366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403bed5-ce28-476c-b6c1-3336bdeb15db None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.552473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2600-ceb8-4d7b-9e84-2babf45dbff4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.565993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.587696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.588354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.588634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.588969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.589727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=e47a97beb009467b9b53222ba5a551fc) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:07.590097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.591876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.595944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.597012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.597488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.597927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.598032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 352/679] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/role_assignments?user.id=e47a97beb009467b9b53222ba5a551fc&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:07.598720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.617585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.620193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.640895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-445bcbd6-0d8d-4fbf-a17a-2bb569b0ea20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:07.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:07.644400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:07.646008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 328/680] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:07.647377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b163-138d-410a-9621-a0500e1066a8 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.647492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b163-138d-410a-9621-a0500e1066a8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.649043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b163-138d-410a-9621-a0500e1066a8 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.649396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 329/681] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:07.651577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b163-138d-410a-9621-a0500e1066a8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.742392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3104c-fd64-48c5-9d69-a19cf4894453 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.784981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b163-138d-410a-9621-a0500e1066a8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.787236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.788103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.788379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.788653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.798253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.799723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ed069395-b063-4d40-8968-c6a5c9cde85c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:07.814685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:07.815657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:07.816603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 353/682] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:07.817639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.817639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.818700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.825115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.825783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.826065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.826335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.827125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:07.827463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.828919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.837993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:07.839562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:07.846570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 330/683] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:07.846570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.877991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.902817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.923982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 354/684] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:07.930486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.961282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed2131-6a69-4380-95dd-0be5a8b9f621 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.998019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.998792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.999143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.999512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.000425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:08.000803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.002752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.027518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 331/685] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:08.028867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.052596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e8ac-65d4-4eb9-b553-570f57bf7f93 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.087479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.088522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.088860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.089201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.090136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=ffb912f209ff452583ce16ca36ae1967) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:08.090811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.092351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.100663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 355/686] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/role_assignments?user.id=ffb912f209ff452583ce16ca36ae1967&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:08.101558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.162140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c06e05-7049-421b-bcbb-3944b2463f17 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.184505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.185581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.208318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.209158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.209439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.209713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.224392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:08.233430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:08.234490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:08.236145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 332/687] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:08.240634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.323824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2987-7d0f-4e82-a4ef-c238ac6c668f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.360931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.361586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.361907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.362279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.366880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e120-4adc-47c8-bd7f-a913aed6c1d5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.408642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.409318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.409599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.409874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.410624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:08.411394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.413291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.424705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 333/688] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:08.432497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.452162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.454032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b522d95-abfb-46c1-a33f-eb76d4641ceb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.489442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.491802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.547150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c14dd-5a56-4a98-98b8-939c1c7c6118 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.571533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 356/689] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:08.573033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5ecf-afa1-4690-9e18-d5931d2bbb36 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.573322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5ecf-afa1-4690-9e18-d5931d2bbb36 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.573620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5ecf-afa1-4690-9e18-d5931d2bbb36 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.575237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 357/690] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:08.580168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b5ecf-afa1-4690-9e18-d5931d2bbb36 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.584843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.585871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.586152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.586421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.600448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.601937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ae6216c1-b056-4062-93e3-ea0d4daf2133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:08.619872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:08.620815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:08.622238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:08.622238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:08.622238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.622238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:08.622238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 334/691] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:08.622691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.622878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.624274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.649556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:08.651052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:08.696412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b5ecf-afa1-4690-9e18-d5931d2bbb36 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.724747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 335/692] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:08.725816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.735090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.748086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.748894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.749170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.749441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.750751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:08.764803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.766247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:08.795063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:08.797389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 358/693] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:08.799926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.829024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3a567-1a0c-434e-8b2e-13782aa1cd35 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.867100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.868373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.868664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.868939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.869919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:08.870224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.871996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.886883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 336/694] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:08.887803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.914017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21ebe7-33fa-4e9a-81a7-280348f577c1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:08.950121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:08.950958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:08.951234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:08.951548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:08.963806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:08.965435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:08.983971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:08.985955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:08.987878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:08.987878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:08.987878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:08.987878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:08.995363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 359/695] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:08.995363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:08.995750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.014972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703ab-6362-41ff-9024-115731047599 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.032247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.061531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.062650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.063131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.063649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.064572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:09.065102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.066840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.080198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 337/696] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:09.081621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.100043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95db55a-1a91-4ab0-80f7-7defa42c6f0c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.135142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.136222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.136500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.136810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.147130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.149294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:09.167732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:09.168771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:09.169720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:09.173958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 360/697] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:09.174783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.198262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef502c-c210-4ef5-b896-ae93935b472a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.236128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.237225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.237705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.238184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.239192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:09.239821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.241483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.254814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 338/698] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:09.255955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.258731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.282350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.288007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f43f1f-4e82-4e0e-b647-ce40a2a76acc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.323270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.324125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.324430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.324938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.333991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.335733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:09.352061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:09.352967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:09.353865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:09.356497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 361/699] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:09.357575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.375550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fe73-ef6c-4bb0-89b5-a12b31f568f9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.419282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.420143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.420428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.420703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.421849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:09.422160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.423881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.444156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 339/700] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:09.445369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.475936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bab4f-cdd6-41f0-99d7-0d1a011d32da None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.514843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.520578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.521272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.521548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.521818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.522546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.525583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.555839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 362/701] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:27:09 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:09.556863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.575386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.582492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d4d4e-d938-49b2-984c-27e5b5b01263 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.659209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.660282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.660705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.661113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.662336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:09.664064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.667592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.688140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 340/702] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:09.695764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:09.737084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f319a-d45b-4c01-bdee-2600656849f5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.798184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.799042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.799594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.799892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.844468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532594-cc7c-4f2d-a5ca-46a372e9e95d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:09.866138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.882357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:09.883025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.883311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.883620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.884457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=c2660c54018042e5af8535a2b7b5e9af) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:09.884840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.887297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393385fe-9fd6-487c-a17e-6fd9f3969be8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.893918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:09.895255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 341/703] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/role_assignments?user.id=c2660c54018042e5af8535a2b7b5e9af&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:09.895462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:09.910142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0f9a-4244-4295-8ccf-3513944ba388 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.910450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0f9a-4244-4295-8ccf-3513944ba388 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.910705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c0f9a-4244-4295-8ccf-3513944ba388 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.911402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:09.913352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 342/704] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:09.918625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:09.918849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:09.919073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:09.938388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:09.939671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:10.018004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 343/705] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:27:10.034616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 363/706] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:10.040622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.054515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.158643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295f385-c5d2-4b64-919c-157afc54f3a0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.169424 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b609c-9a76-4cca-949a-117411713cfe None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.174365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.186494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.199684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.200645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.201116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.201476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.210117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.211235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.211696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.212131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.212993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.213240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.214742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.215001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:10.230145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:10.231298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:10.232175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.235184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 364/707] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:10.235645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:10.236500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:10.237427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:10.237427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:10.237427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:10.237427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:10.239488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 344/708] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:10.242663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.248508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.355748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2af48-9c38-4d04-8b79-92e7d79a3bda None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.370620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d1615-f276-4acc-b33a-c257c7f83fd6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.391146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.392196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.392673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.393163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.394082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:10.394581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.396206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.401457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 365/709] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:10.408622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.411568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.412383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.413741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.414016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.414756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:10.415057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.416474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.430207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 345/710] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:10.435986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.459045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.475913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.533987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493c02c-b8ad-41d0-be3e-2743aae3d541 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.567306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6779c-4050-46c9-8119-c48bf0e9280e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.581222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.582356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.582914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.583198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.584272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:10.584580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.586373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139662-2749-4321-bae8-2cd6b38c7f99 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.595616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 366/711] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:10.596940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f655c-3910-4cff-b34c-9afb4d59963b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.597228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f655c-3910-4cff-b34c-9afb4d59963b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.597509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f655c-3910-4cff-b34c-9afb4d59963b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.599076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 367/712] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:10.604730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.605097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.606007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.625404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:10.626705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:10.632138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.632963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.633243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.633514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.648568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.650046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:10.688222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:10.689294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:10.691205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 346/713] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:10.695393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.705926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 368/714] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:10.739697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.805378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.841751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:10.863244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505c34d-ffa2-4083-8ae4-fe51433d7f9d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.885344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b76b-ec33-4684-92f0-dc2c79b4ec46 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:10.904359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.905379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.905890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.906414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.907486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:10.908018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.909892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.920836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:10.921637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:10.921914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:10.922271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] PATH_INFO: `/v3/services/network` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:10.922970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:10.924374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:10.925464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 347/715] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:10.932456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:10.941128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:10.942136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:10.943003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 369/716] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:10.952521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:11.125350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdab0a-fcdf-4511-9573-83c4ecdae54a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:11.126014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:11.136126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c02a31-7412-4231-adb4-dc4851488c0d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:11.190857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:11.191546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:11.191824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:11.192094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:11.192924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:11.193230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:11.194680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:11.200492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:11.201156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:11.201434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:11.201708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:11.202416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] RBAC: Adding query filter params (name=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:11.202720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:11.204094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d717a-684f-4338-95eb-677372c8dd75 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:11.215424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 348/717] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:11.218106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 370/718] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:11.224146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:11.251777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:11.343168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa32e8-121c-4112-9c34-947a847c2fab None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:11.378701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:11.379304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:11.379617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:11.379892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:11.380609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:11.380911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:11.382301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7ceb7-781d-420f-8b3d-e4b06296b7d2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:11.388929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 349/719] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:12.165161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8f00-3a0e-4984-a169-174601c8038a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.165773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8f00-3a0e-4984-a169-174601c8038a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.165773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8f00-3a0e-4984-a169-174601c8038a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.167267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 371/720] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:12.181169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.181617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.181730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.206796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:12.208019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:12.293133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 350/721] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:12.328314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8f00-3a0e-4984-a169-174601c8038a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:12.455046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8f00-3a0e-4984-a169-174601c8038a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:12.505894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:12.506706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.506978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.507246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.522355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:12.530142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:12.531071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:12.531965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 372/722] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:12.537076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:12.544481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:12.691309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b31f3-cf82-42b3-8302-6ac666c919be None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:12.724610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:12.725216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.725498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.725771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.726519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:12.726820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:12.728250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:12.736667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 351/723] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:12.742063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:12.781240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:12.896561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f3ba-590e-4b70-9aca-620c942c0c59 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:12.940082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:12.940882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.941158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.941428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.956699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:12.958162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d1041387-5d36-444c-a299-34bef849d4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:12.985364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:12.986412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:12.987303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:12.987303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:12.987303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:12.987303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:12.987303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 373/724] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:12.992094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:12.996761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5795c5-4f37-4f47-a1b1-0dfe341086ca None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:12.997046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5795c5-4f37-4f47-a1b1-0dfe341086ca None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:12.997318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5795c5-4f37-4f47-a1b1-0dfe341086ca None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:12.998959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 374/725] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:13.004202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaebfe-3d5f-458f-a2e2-1139fa6090ac None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.004486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaebfe-3d5f-458f-a2e2-1139fa6090ac None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.004764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaebfe-3d5f-458f-a2e2-1139fa6090ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.033128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5faaebfe-3d5f-458f-a2e2-1139fa6090ac None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:13.034417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5faaebfe-3d5f-458f-a2e2-1139fa6090ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:13.099778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.131360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 375/726] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:27:13.131360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053516-8fa1-4794-8efd-557c0011b15e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.131360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053516-8fa1-4794-8efd-557c0011b15e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.131360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053516-8fa1-4794-8efd-557c0011b15e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.131360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 376/727] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:13.135940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.136225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.136575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.147540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.154010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c6fb-195f-4c7a-a9c2-175959ff7517 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.158287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:13.160332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:13.191852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.193306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.193784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.194316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.195225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:13.195742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:13.197427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:13.210628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 352/728] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:13.211967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.234548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 377/729] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:27:13.235552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.317942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f2c13-7a4e-4a98-a03d-3fbf58027dac None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.337764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b8d0-d247-4573-b02d-a081371e218c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.345986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.355362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.356349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.356997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.357475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.358544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:13.360155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:13.376907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.377735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.378012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.378286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.385390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 353/730] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:13 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:13.385390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.387508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.398186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:13.401892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:13.429258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:13.430295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:13.431211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:13.432689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 378/731] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:13.438363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.606318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7801d7-7f17-4f62-8c6e-4d8452598251 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.624905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ef2e5-0c62-419b-a3a3-e0b75f5c6eac None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.645047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.645861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.646138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.646691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.662662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:13.665526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.666337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.666713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.667080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.668001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:13.668311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:13.669743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbb6f-e266-4a17-baa1-d408510b1e6e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-690a8d08-a345-4ace-8783-cc68e1b3dd1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:13.673835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:13.674792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:13.675680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 354/732] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:13.677216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5039d8-eb06-43ac-b2c8-b5b5fbe042ab None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.677395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5039d8-eb06-43ac-b2c8-b5b5fbe042ab None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.677947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5039d8-eb06-43ac-b2c8-b5b5fbe042ab None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.679001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 355/733] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:13.684055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5039d8-eb06-43ac-b2c8-b5b5fbe042ab None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.692461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 379/734] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:13.695453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.695453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.695453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.713265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:13.714686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:13.743835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.775702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:13.792611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 380/735] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:13.793523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.827571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5039d8-eb06-43ac-b2c8-b5b5fbe042ab None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.875791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468080d-2478-4463-b709-4755534794d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.876917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468080d-2478-4463-b709-4755534794d7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.877200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468080d-2478-4463-b709-4755534794d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.877735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468080d-2478-4463-b709-4755534794d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:13.878496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468080d-2478-4463-b709-4755534794d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:13.878835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468080d-2478-4463-b709-4755534794d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:13.881380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468080d-2478-4463-b709-4755534794d7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:13.894339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 356/736] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:13.895254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468080d-2478-4463-b709-4755534794d7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:13.916655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a285f9-e115-4836-b1ab-fb51c295917c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:13.953067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:13.953783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:13.954064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:13.954337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.003916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.017697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468080d-2478-4463-b709-4755534794d7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.021621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.023179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.024801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a38c-dd11-48ce-a180-52600a258da5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.055081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.055910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.056190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.056730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.066632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:14.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:14.075406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:14.076288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 357/737] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:14.077030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.139595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 381/738] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:13 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:27:14.140767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dcc1-1c23-4de6-ad6c-3c7a8f2cdfc4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.141054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dcc1-1c23-4de6-ad6c-3c7a8f2cdfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.141328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dcc1-1c23-4de6-ad6c-3c7a8f2cdfc4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.142687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 382/739] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:14.143252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20dcc1-1c23-4de6-ad6c-3c7a8f2cdfc4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.194823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dde92-4c5d-4a9c-80b2-06b0e9384868 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.227703 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.231071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.231910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.232194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.232472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.243898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.245543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.249827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20dcc1-1c23-4de6-ad6c-3c7a8f2cdfc4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-25fb1515-e3c7-4666-81c8-d7b183f0166d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:14.263578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:14.264471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:14.265368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:14.265368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:14.265368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.265368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:14.265368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 358/740] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:14.266408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.266408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.266570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.282744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:14.283955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:14.288910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.289574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.289854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.290126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.290859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:14.291166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.292557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.295112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.304012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 383/741] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:14.308619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.354131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 359/742] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:27:14.354963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.426091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74cde-0523-46cd-a7f0-c42e85232041 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.456414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528418-5640-4220-938c-10e67a0c4001 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.465159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.466547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.467050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.467568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.478729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.480293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.483350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.490924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.491608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.491889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.492159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.492877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:14.493180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.494548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:14.498931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:14.499982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 384/743] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:14.506003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.514996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 360/744] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:14.514996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.522086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.607298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701a3b-a32a-4ce9-9441-7ee274df9753 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.618614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac81c3-95c0-4d2f-83a7-ff4ae22d921c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.641924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.642721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.643244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.643244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.653809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.654189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.654468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.654748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.655018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.655690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.655787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.657114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.672954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 361/745] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:14 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:14.673929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:14.674147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:14.674993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:14.675926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:14.675926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:14.675926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:14.675926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:14.681220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 385/746] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:14.681220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.756185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.770056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:14.823157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b03b-d8a3-45af-b693-0fafaa1b0333 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.825633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e913-3d60-4c83-82a4-3132b98da7f1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:14.865278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.865949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.866231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.866506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.867231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:14.867559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.868950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.872908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:14.873964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:14.874236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:14.874514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:14.884715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 362/747] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:14.885510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:14.886087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:14.888396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:14.905247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:14.906236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 386/748] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:14.907198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.010281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a97464-6fbe-41d9-b7be-7e329218d495 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.037140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.051273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.052447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.053041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.053512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.054439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:15.054940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.056760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.074184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 363/749] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:15.075567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.156785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896346e2-4738-4da0-af2a-709a842da153 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.166101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.188399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5343-599a-4ba3-85f3-e5b257a2d5fb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.193359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.194167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.194448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.194720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.203218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.204721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:15.219257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:15.220196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:15.221061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:15.225221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 387/750] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:15.226081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.226585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.227371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.227725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.228064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.229096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:15.229471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.231151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.251016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 364/751] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:15.251987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.298411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.332927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a061c-da83-4676-a6c2-3d215f272e2f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.363180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7e8f-6487-4098-858e-1a3d54bca860 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.367540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.368379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.368687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.368964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.376521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.378019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:15.392948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:15.395047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 388/752] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:15.396742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.404932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.405608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.405893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.406167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.406965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:15.407276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.408858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.422301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 365/753] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:15.423077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.434230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.509736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138ad32-32b3-4228-9e0a-bc8c5e4cabbd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.534865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.539238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34801e-4905-42d7-b25f-e5f016076e1e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.548264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.549315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.549555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.549829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.574502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522821-c089-44b6-965c-2135a283b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.575172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522821-c089-44b6-965c-2135a283b49d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.575485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522821-c089-44b6-965c-2135a283b49d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.575770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522821-c089-44b6-965c-2135a283b49d None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.576649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90522821-c089-44b6-965c-2135a283b49d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:15.576966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90522821-c089-44b6-965c-2135a283b49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.578408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90522821-c089-44b6-965c-2135a283b49d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.601136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 366/754] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:15.601136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522821-c089-44b6-965c-2135a283b49d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.626718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.628334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351fb6d-dd77-44da-aee3-7016a50ef681 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.655844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.698175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522821-c089-44b6-965c-2135a283b49d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.729520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 389/755] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:15.731181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d99c5-d64e-474c-8c8d-b81687ce7bd3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.731666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d99c5-d64e-474c-8c8d-b81687ce7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.732103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d99c5-d64e-474c-8c8d-b81687ce7bd3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.735773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.736851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.737353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.737796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 390/756] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:15.738167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.738508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d99c5-d64e-474c-8c8d-b81687ce7bd3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.739752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=40e26487f27e4a0c81cfbf3cbe229045) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:15.740324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.742483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.749562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 367/757] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/role_assignments?user.id=40e26487f27e4a0c81cfbf3cbe229045&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:15.750384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:15.795489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.897938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb461-c1c5-464d-a34a-f1b4982859fd None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.905013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d99c5-d64e-474c-8c8d-b81687ce7bd3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:15.938331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.939472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.939960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.940409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.941648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:15.950817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:15.951834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.952090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.952204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.952511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.954099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.965961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:15.968885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-68a44679-a6c6-445c-9c85-03877a0d602c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:15.974304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:15.975166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:15.976112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:15.976112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:15.976112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:15.976112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:15.978492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 368/758] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:15.979948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46e61-b899-4896-9360-106a585fdeec None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:15.980484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46e61-b899-4896-9360-106a585fdeec None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:15.980932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46e61-b899-4896-9360-106a585fdeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:15.989480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:15.990399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:15.991303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:15.991303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:15.991303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:15.991303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:15.993404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 391/759] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:15.994267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.003360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-85b46e61-b899-4896-9360-106a585fdeec None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:16.004778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-85b46e61-b899-4896-9360-106a585fdeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:16.083463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 369/760] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:16.084730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b46e61-b899-4896-9360-106a585fdeec None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.091757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.115198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe67ff-6707-4965-9298-8fe2a9118573 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.163307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.164018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.164365 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.164706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.165500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.165885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.167512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.184269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 392/761] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.188241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.218341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b46e61-b899-4896-9360-106a585fdeec None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.242903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.257271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.258590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.259176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.259809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.260770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.261262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.263103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.279609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 370/762] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.280901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.311978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bec06-a046-4d95-b19b-7e39eaeca4ec None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.347886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.354751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.355835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.356124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.356394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.357813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.359199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:16.374391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:16.375366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:16.376223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 393/763] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:16.377063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.398668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a451d60-1e9b-4e9f-99d6-afebd30bb53e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.442744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.443509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.443791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.444065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.453005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.455254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:16.474798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:16.475828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:16.476714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 371/764] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:16.477233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.496037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d69595-c4be-4fc6-a018-67f0ab446728 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.500708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.547357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.547357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.547357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.547357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.557695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.559217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:16.585560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:16.586562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:16.587509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:16.592022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 394/765] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:16.592853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.648490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a6c6-fbc9-44c4-bcfa-b7bf0ff4177a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.676484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.690245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.691367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.691847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.692313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.693288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.693786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.695500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.700692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 372/766] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.701736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.738871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5481de-39bc-4caa-8243-afc46a416452 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.784584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.785253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.785779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.786058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.787232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.787566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.788994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.803740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 395/767] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.804460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.831263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:16.864168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688735-99d4-4bdd-9a79-09f6a2688f17 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.909332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.910436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.910762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.911141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.911524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86861-6b78-446b-99b5-f1cb0872ca4b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:16.912648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.913047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.915749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5018-6db1-4acb-8745-e9ee3a16f45d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.933472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 373/768] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.934820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c664-b8e5-4262-a2c6-d03be0d5cb96 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.935105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c664-b8e5-4262-a2c6-d03be0d5cb96 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.935376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c664-b8e5-4262-a2c6-d03be0d5cb96 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.936597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 374/769] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:16.937276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c664-b8e5-4262-a2c6-d03be0d5cb96 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:16.961794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:16.962411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:16.962646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:16.962916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:16.965795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:16.966163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:16.968732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:16.979844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 396/770] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:16.979844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.005959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.087048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c664-b8e5-4262-a2c6-d03be0d5cb96 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.093327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.110364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66317cc-d692-4ada-ae57-be955057ba3d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.133794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.134574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.135035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.135244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.136106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=c2660c54018042e5af8535a2b7b5e9af) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:17.136930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.138441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639a555-0c00-4170-83d0-0a91c998105e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.151713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 375/771] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:16 2022] GET /identity/v3/role_assignments?user.id=c2660c54018042e5af8535a2b7b5e9af&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:17.151713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.151713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.151713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.152978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.154156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.154156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.154156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.156428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=db1031b48c8142508bd94fe89142a9ef, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.158041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.169220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:17.170693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:17.177159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 397/772] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:16 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:17.178136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.337924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf40a-e7d2-46bd-9438-2af294db0959 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.345419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 376/773] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:17.379710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.394696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.395651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.395935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.396257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.397070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] RBAC: Adding query filter params (interface=public, service_id=9fac9d5edb3741e8bf06ffb7da56d725, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:17.397383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.398968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.410182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 398/774] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:17 2022] GET /identity/v3/endpoints?service_id=9fac9d5edb3741e8bf06ffb7da56d725&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:17.422721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.431659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.446461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.533848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364bde-1465-4ed9-9c3a-a519d629a36c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.579324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.581502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.582137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.583583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] PATH_INFO: `/v3/services/network` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.585432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.587724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.600443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1b0c-7210-4fe6-a091-7be0128f7534 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:17.611593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:17.612623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:17.613444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:17.621524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 377/775] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:17 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:17.628481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.669245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.671259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.671772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.672439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.674281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.675874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.686307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 399/776] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:17 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:17.769413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f0762-1fe7-41bd-98e6-c077c0a45003 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:17.777857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.810437 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f518914-1505-4282-9c37-f160791a068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:17.811181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518914-1505-4282-9c37-f160791a068e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.811488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518914-1505-4282-9c37-f160791a068e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.811811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518914-1505-4282-9c37-f160791a068e None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.812536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f518914-1505-4282-9c37-f160791a068e None admin] RBAC: Adding query filter params (name=network) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:17.812837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f518914-1505-4282-9c37-f160791a068e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:17.814221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f518914-1505-4282-9c37-f160791a068e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:17.819730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 378/777] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:17.826111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:17.859832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273359-d658-418d-8eb6-ee4eba12b0e3 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.860135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273359-d658-418d-8eb6-ee4eba12b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.860316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273359-d658-418d-8eb6-ee4eba12b0e3 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.861954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 379/778] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:17.867315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:17.867626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:17.867905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:17.885254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:17.886504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:17.969131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:17.983547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 380/779] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 23 13:27:17.995282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d30d-1c99-4f21-92b0-52ffe72a2941 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.006823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.035070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.035971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.036355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.036673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.037387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:18.037691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.040035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.047450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 400/780] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:18.052142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.123771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:18.128104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fefd6-0c42-4b30-8a38-ed9e45dd1f0c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.172154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.173180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.174491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.174670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.195320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:18.208204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:18.209133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:18.209990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 381/781] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:18.217538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500b9b-f06a-408c-813d-a92cc53080bd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.219900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.256393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.257127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.257408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.257681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.258477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] RBAC: Adding query filter params (interface=public, service_id=3dfd51b9eb074d419f8959a035b88083, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:18.258791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.260253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.266415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 401/782] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/endpoints?service_id=3dfd51b9eb074d419f8959a035b88083&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:18.271284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.275218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:18.403358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7cfe7-48ad-44bc-9aaf-0be4c25a8c7c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.432112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.432819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.433208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.433491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.434304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:18.434614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.436168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.442611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7e8e6-5db9-44cc-97f8-7edc7612d75b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.453073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 382/783] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:18.462901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.520130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:18.546364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.547036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.547317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.547689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.548381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.549816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.563540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 402/784] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:18.622659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44028158-c295-4a69-a684-d686c2005c5d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.669159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.670316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.670811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.671276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.682929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.684827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:18.702959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:18.703953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:18.704839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:18.704839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:18.704839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:18.704839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:18.707210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 383/785] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:18.715678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:18.793568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:18.827615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fa10e-ec0e-48c1-a3c6-6729bd8cbd76 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:18.864081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:18.865206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:18.865621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:18.865956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:18.866776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:18.867144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:18.868873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:18.884410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 403/786] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:18.890600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.001982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:19.038223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79b9f-c041-4294-aec9-ee3ac65be929 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:19.072236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:19.073055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.073334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.073606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.082070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:19.083559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:19.106429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:19.107478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:19.108436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 384/787] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:19.114031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.270576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3889f-49d0-484a-93a4-44249a480794 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:19.312987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:19.325106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:19.325793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.326067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.326337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.327175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:19.327504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:19.328921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:19.351846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 404/788] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:19.357201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.481175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a203-bd69-492b-af04-ac1431b93a83 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:19.526928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:19.527746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.528027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.528302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.530317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:19.540546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:19.542054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-64a473bc-5a67-44df-9f43-87c40895072f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:19.564976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:19.565916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:19.566809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:19.566809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:19.566809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:19.566809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:19.566809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 385/789] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:19.571892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.586411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512012a-b355-4eb0-b452-938cd570754b None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.587000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512012a-b355-4eb0-b452-938cd570754b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.587518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512012a-b355-4eb0-b452-938cd570754b None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.589467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 386/790] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:19.594941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.595500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.595979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.613438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:19.614958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:19.717342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 387/791] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:19.740736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.755189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775ba4-6447-47c2-bed5-c1bbfee9d4b9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:19.820763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:19.820953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.821108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.821454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.822201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:19.822512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:19.829134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2c44-069e-4e78-a2e8-0bb6d2eff773 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:19.840649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 405/792] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:19.841841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96b7d-a40b-45df-93cc-3080e6e0703c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.842120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96b7d-a40b-45df-93cc-3080e6e0703c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.842392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96b7d-a40b-45df-93cc-3080e6e0703c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.848212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 406/793] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:19.848994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96b7d-a40b-45df-93cc-3080e6e0703c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:19.858042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca995d7-e348-4ce9-b49c-e31353ae8f0d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:19.876503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:19.896768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:19.897718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.898065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.898429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.900255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:19.912757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-98cfbd46-f761-4f2e-b3b0-b3cbba0dc0b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:19.921379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:19.922314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:19.923159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:19.925989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 388/794] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:19.927499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:19.927948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:19.928379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:19.947084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:19.948583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:19.969087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96b7d-a40b-45df-93cc-3080e6e0703c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.011188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.012374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.012826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.013272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.020797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.022596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:20.037380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:20.038306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:20.039172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:20.039617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 389/795] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:20.039617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.046420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 407/796] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:20.047629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.152910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b16346-117a-4ff5-8d43-44c2633ae4e1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.160616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.173006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a22d65-5b27-49a4-b789-eb1728552524 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.181032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.192761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.193683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.194133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.194577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.195682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:20.196198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.197886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.209980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.210662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.210993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.211279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.215665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:20.215665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.215665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.216018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 408/797] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:20.217149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.224453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 390/798] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:20.225354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.321154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59584d9-4d83-4eae-9acd-02106bcb767f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.334226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3263852-a1b2-4cde-92b4-bfb2e7fa7c63 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.357251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.358507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.358962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.359433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.370692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:20.372189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.373259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.373607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.373953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/40e26487f27e4a0c81cfbf3cbe229045/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:20.379753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:20.380659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:20.381566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:20.384427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 409/799] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:20.385463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.396405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=40e26487f27e4a0c81cfbf3cbe229045, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.397902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.423487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 391/800] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:20 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/40e26487f27e4a0c81cfbf3cbe229045/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:20.423487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.436596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.450184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.540957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69458aa-9fae-45ec-8c0d-36aca37f89e5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.566424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272064-a9bf-44f7-bb35-225ca46d46ba None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.591170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.592553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.592841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.593117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.606762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.607797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.608296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.609178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.609660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.610144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.611160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:20.611737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.613364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe63db-c67f-4a3d-a08f-dff87c9ea771 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.622979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 392/801] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:20.624673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb5eaa-ce57-466c-83b4-8931080dd514 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.625161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb5eaa-ce57-466c-83b4-8931080dd514 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.625668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb5eaa-ce57-466c-83b4-8931080dd514 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:20.626982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:20.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:20.628761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:20.628761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:20.628761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:20.628761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:20.628761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 410/802] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:20.629042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.633000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 393/803] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:20.634829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb5eaa-ce57-466c-83b4-8931080dd514 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.730810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.737800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.757194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb5eaa-ce57-466c-83b4-8931080dd514 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.764880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31a80-dbe7-48c5-8825-47879ff77705 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.795811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.796868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.797467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.798087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.799056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:20.799622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.801430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241a43-00ca-4c67-ba0a-ff76cfdb4a40 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.806457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:20.807253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.807555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.807828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.816430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 394/804] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:20.818244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:20.818730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:20.819202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:20.820738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:20.822942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:20.840674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:20.841866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:20.846170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:20.847030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:20.847984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:20.847984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:20.847984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:20.847984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:20.850207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 411/805] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:20.851188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.920563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 395/806] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:20.921748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:20.966310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb8b1-c00a-4133-9d3f-061702d6e69a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:20.994743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:20.999047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.002868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.003758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.004041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.004313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.013078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.014514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-6c6c8093-1c1e-400b-8713-fe5f83b422e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:21.028857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:21.029827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:21.030772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.034583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 412/807] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:21.035007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc65fda-633f-49a2-8a31-aeefa195486c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.035837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a816-1c69-4169-baa6-7b1047b44d9a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.036119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a816-1c69-4169-baa6-7b1047b44d9a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.036497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a816-1c69-4169-baa6-7b1047b44d9a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.038117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 413/808] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:21.038342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a816-1c69-4169-baa6-7b1047b44d9a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.074151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.075289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.075289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.075623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.076081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.076385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.077769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.091495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 396/809] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.092404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.151978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a816-1c69-4169-baa6-7b1047b44d9a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.188573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.189320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.189612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.189889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.190549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.191966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.202230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19290-1a64-4487-92d9-158e52c11c3b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ac71658e-b9ce-48ee-983c-532da93f4eb1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:21.204253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:21.205259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.206090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 414/810] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:21.206913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.206913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.207425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.224887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:21.226071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:21.238797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.245272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.245972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.246251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.246520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.247376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.247684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.249131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.271203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 397/811] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.272132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.277850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.303364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 415/812] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:21.303364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.380909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001777c-f6be-4164-a414-8c4e206c69b4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.406397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b6417-810a-431e-90a5-246329574f2f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.418127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.419323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.419704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.420055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.428740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.430717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.446738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.447455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:21.447743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:21.448930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:21.450108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:21.450769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.450769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.450769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.451373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.452373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 398/813] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:21.453053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.458932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.464248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 416/814] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.469618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.507799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.523407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.558408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536f498-a397-4963-9db2-1eb1c4667c44 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.583701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc293-7380-4e88-b81a-c9f72c57df20 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.597349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9270-db0a-4764-997b-8e287222362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.598246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9270-db0a-4764-997b-8e287222362f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.598602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9270-db0a-4764-997b-8e287222362f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.598947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9270-db0a-4764-997b-8e287222362f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.610080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e9270-db0a-4764-997b-8e287222362f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.611673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e9270-db0a-4764-997b-8e287222362f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.619979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.622052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.622777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.623371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] PATH_INFO: `/v3/services/network` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.624211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.625782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-573e9270-db0a-4764-997b-8e287222362f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:21.629826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:21.630863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 399/815] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:21.631819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9270-db0a-4764-997b-8e287222362f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:21.641407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:21.642530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:27:21.643519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:21.650694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 417/816] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:21.650694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.737672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.741316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9270-db0a-4764-997b-8e287222362f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.749131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca5825-251e-4c3e-a58e-c5f38fd2eb5d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.767188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:21.781452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.782130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.782416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.782691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.783704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.784018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.785585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.792714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.793377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.793656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.793934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.794640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.794942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.796321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.804768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 400/817] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.805872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 418/818] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.806165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.806719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:21.910194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d64e-8ae9-4602-88e7-1f24ab279fa4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.912785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16f3c-fb1e-4089-ad37-545326bdc59c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:21.946171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:21.946856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:21.947139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:21.947440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:21.948162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:21.948469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:21.949919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:21.960254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 419/819] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:21.960254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.008329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.066157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.067250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.067250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.067557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.068311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:22.068616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.070003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.074233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d56de5-ce0d-4588-92d0-447a84eb9ec5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.086360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 401/820] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:22.086360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.116297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.116969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.117233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.117506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.118247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.119650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.120448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.143352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 420/821] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:22.144558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.226020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276a19-b7cf-4389-97cc-523bf5c855a4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.271951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.272860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.273281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.273692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.282597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.291327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328a12-f06d-452b-8d8b-83fc6a7c5041 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.335544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.336210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.336495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.336766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.337463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] RBAC: Adding query filter params (type=network) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:22.337773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.339147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.344971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 421/822] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:22.345707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.362769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.364273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.380970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.457146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d22fd-af98-4354-b113-1b0659de1023 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.494517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.495854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.496310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.496753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.507295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 402/823] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:22.507295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.507846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.508446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-c9e55695-1ef1-443a-b8fb-7a8afda54353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:22.523864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:22.524751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:22.525617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:22.529690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 422/824] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:22.530928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998ad6-d66c-429b-9210-809eaec7decd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.531217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998ad6-d66c-429b-9210-809eaec7decd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.531529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998ad6-d66c-429b-9210-809eaec7decd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.532935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 423/825] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:22.533741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998ad6-d66c-429b-9210-809eaec7decd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.557688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.611886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d8d54-c049-4c69-839b-726f828c77ca None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.627870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.649466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998ad6-d66c-429b-9210-809eaec7decd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.650227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.650901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.651186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.651491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.652309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.653701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.675632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 403/826] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:22.676563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.713908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.715677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.716296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.716683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.730125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.731827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5825879f-bfae-4d68-9149-9e32e0724513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:22.757397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:22.758481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:22.759419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:22.759419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:22.759419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:22.759419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:22.763521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 424/827] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:22.768185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.768859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.769328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.788290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:22.789985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:22.805989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167bcf-3e0d-4a2c-b356-812e3dcfdaae None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:22.846352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:22.847155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:22.847474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:22.847753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:22.848565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:22.848873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:22.850498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:22.865286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 404/828] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:22.866401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.885383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.899987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 425/829] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:22.901207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:22.911024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:22.998423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df43b8-4c04-41a0-bb5c-02c83bbbdcd8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.016943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c03c-1e30-402f-b267-2d71d8738d48 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.034860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.035555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.035837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.036112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.036832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:23.037136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.038574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.050322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 405/830] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:23.051097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.057447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.059377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.059835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.060369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/c2660c54018042e5af8535a2b7b5e9af/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.062519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=c2660c54018042e5af8535a2b7b5e9af, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.064619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.083860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 426/831] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:22 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/c2660c54018042e5af8535a2b7b5e9af/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:23.085343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.166566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.179275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3a57-f9c4-459a-9114-467119d39f0b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.184079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.219673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.220648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.220932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.221204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.233515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:23.239603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470acb3-6817-44d6-9e2f-8bd302f2c620 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:23.241952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:23.242871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:27:23.243772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:23.248051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 406/832] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:23.249114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.287367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.288455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.288793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.289010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.298340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.299660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:23.319957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:23.320917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:23.321825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 427/833] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:23.327622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.369950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a836da-3dd3-4bb5-9dd3-0f2c096482f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.405902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.406967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.407493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.408034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.409039 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:23.409539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.411136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.420421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 407/834] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:23.426000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.434443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeb392-a396-4407-8df2-efc3c7790ad0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.442552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.452600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.471524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.472255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.472539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.472815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.473620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:23.473931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.475380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.493306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 428/835] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:23.494613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.538038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f2dd-afb2-4794-844e-25f783822bf5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.573276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.574522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.575014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.575559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.586895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.588692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.598088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d79-ff57-48ea-b919-8d7661e45af6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:23.607553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:23.608447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:23.609359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:23.609359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:23.609359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:23.609359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:23.615948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 408/836] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:23.617468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.634359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.635021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.635298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.635608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.636521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:23.636827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.638271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.651487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 429/837] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:23.689760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.736213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1f33-a598-4e6a-8946-bc0b19e40a55 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.774608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.775724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.776210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.776746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.777687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:23.778193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.779903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.794512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 409/838] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:23.800465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:23.847209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:23.905888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dccec9-489b-4cf5-b086-8145958a86b6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:23.939874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:23.940699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:23.940978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:23.941252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:23.949152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:23.950593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:23.965591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:23.966558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:23.968150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 430/839] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:23.972820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.076991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ecff-65af-4ed1-83c5-e9a5851cfeb9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.104074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.116058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.116745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.117032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.117312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.118157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:24.118531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.120288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e027d-62fc-4e77-94bd-02b0c28afc66 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.141581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 410/840] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:24.147143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.240227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659a49-2245-4d75-9727-d875a662894d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.240581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659a49-2245-4d75-9727-d875a662894d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.240777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659a49-2245-4d75-9727-d875a662894d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.245816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 411/841] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:24.247566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.247845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.248114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.260857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda4180-23c3-44c4-a4de-6429a53ecbfc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.262787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.266785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:24.268003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:24.299697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.300787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.301268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.301739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.356062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 412/842] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:24.377675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.388769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.390690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.501912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 431/843] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:24.507042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.508363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce1dfa-5540-41bb-b5af-9ddc9f8c7aa3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.509583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.524460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.548341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.549581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.550066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.550567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.551474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.553059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:24.565962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:24.566984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:24.568220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:24.575532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 413/844] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:24.576956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.632730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5288-8b52-45a6-85d4-386a2652da25 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.678543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.679387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.680037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.680326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.683182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12054524-bb8d-40f2-a9f6-0f56b36b2b96 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.693371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.695245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:24.719055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:24.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:24.720971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:24.720971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:24.720971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:24.720971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:24.723481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 432/845] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:24.726125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.730047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.730842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.731225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.732340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.732340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:24.732537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.734077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.743763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 414/846] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:24.745058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:24.789750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.800806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:24.861431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596a612-5d7b-412b-b658-c9a1289bb6b0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.868368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36623e-2168-40ae-89b2-5d7d962a458e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:24.899188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.900044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.900338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.900620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.901340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:24.901652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.903221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.915156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:24.915541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 415/847] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:24.916434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:24.916912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:24.917463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:24.918443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:24.918977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:24.920632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e54cb-bf25-4c02-b3b8-ad197afed6b0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:24.939980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 433/848] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:24.941127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.061212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bddc70-bd04-4cbd-8f76-28277e1bc74e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.064079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:25.103873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.105381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.105876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.106361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.114923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:25.116432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:25.127272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1188-bfba-4d0a-8773-739036710659 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.127636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1188-bfba-4d0a-8773-739036710659 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.127859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1188-bfba-4d0a-8773-739036710659 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.129497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 434/849] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:25.134105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:25.134978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:25.135935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:25.136441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.136441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.136441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.136641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 416/850] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:25.142467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.153273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:25.154388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:25.233027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 435/851] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:25.256194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.264889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771119f-bce4-4483-9801-65de714ee62d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.307123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:25.314286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.316284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.316807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.317751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.319002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:25.319928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:25.322203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:25.344041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 417/852] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:25.346795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.370782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206d62e-0dcb-415a-9b90-b43f92236c2e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.381507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:25.412338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.413503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.413800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.414078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.428308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:25.438011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:25.438974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:25.439856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:25.440517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 436/853] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:25.446687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.462541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5212f-f671-4793-99b5-ae7a9a99f668 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.503596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.504697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.505116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.505495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.506638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=40e26487f27e4a0c81cfbf3cbe229045) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:25.507462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:25.509459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:25.517905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 418/854] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/role_assignments?user.id=40e26487f27e4a0c81cfbf3cbe229045&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:25.568166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8bdf-7c6a-41cb-ab0e-d4cd31a25210 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.570948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:25.607419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.608124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.608407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.608679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.609446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:25.609753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:25.611148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452354e2-c356-4cfd-8926-f0ff0a6265a9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:25.621230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 437/855] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:25.626873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.721004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:25.735377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5f9c-0654-4c80-9b23-86c4e9b6d32a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.770804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.772033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.772453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.772876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.775770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e388-93c7-46f4-9402-7c912f49e8da None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.776566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e388-93c7-46f4-9402-7c912f49e8da None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.777113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e388-93c7-46f4-9402-7c912f49e8da None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.778662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 438/856] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:25.783857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.784392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.784864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.789605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:25.790172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:25.805650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:25.806830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:25.812736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:25.813632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:25.814523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:25.814523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:25.814523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:25.814523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:25.814523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 419/857] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:25.821161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.889572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 439/858] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:25.912157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:25.950973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bbcba-1c3c-4142-8db8-7b5f7beee175 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:25.997398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:25.998128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:25.998545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:25.998822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:25.999833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:26.000166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.001894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.011260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.015727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.017740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab83b0-af63-4897-821d-ea307e6af792 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.020476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 420/859] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:26.027460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.054773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.055874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.056516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.056863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.057845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.059474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:26.074999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:26.076030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:26.076899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:26.079415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 440/860] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 23 13:27:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:26.082341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.160731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1867956-30bf-4f4a-a184-26ea579e0841 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.196431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.197263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.197685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.198142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.203763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373881-3239-40f5-8d01-7a4e583a1fb9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.208243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.209758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:26.225395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:26.226464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:27:26.227444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:26.231373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 421/861] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:26.232195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.248247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.249344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.250022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.250436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.251688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:26.252134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.254141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.265189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 441/862] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:26.266312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.298356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.301163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.342719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cceb7-c170-4d94-b714-2bac36133e38 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.377982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.378654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.378934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.379208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.380091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:26.380401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.381911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.401876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4974dd-d903-4b97-a04e-c5d5ab9c8a89 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.404460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 422/863] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:26.405338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.450685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.451370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.451655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.451929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.452632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:26.452939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.454814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.462686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 442/864] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:26.527241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48a855-0b50-433f-b25f-425f4369ee57 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.547821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.567151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.567860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.568145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.568423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.644571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.646052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.750277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 423/865] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:26.755722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.851140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:26.863708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b55-558f-48b9-9f19-bdf517c44a04 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:26.898784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:26.899631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:26.899912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:26.900191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:26.911311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:26.912793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:26.930021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:26.932034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:26.933431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:26.933431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:26.933431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:26.933431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:26.933431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 443/866] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:26.940460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:26.959884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:27.048671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994e5b-3543-4521-a399-4fcdd6b595e5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.086675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.087836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.088361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.088847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.089893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:27.090711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:27.092323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc194-11fd-4e02-8f0e-791261e66949 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:27.105152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 424/867] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:27.114482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:27.164381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392d60-5c60-4a24-b3b9-0c6e79d7a567 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.164745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392d60-5c60-4a24-b3b9-0c6e79d7a567 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.164938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392d60-5c60-4a24-b3b9-0c6e79d7a567 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.166557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 425/868] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:27.171677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.171963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.172242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.189729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:27.190924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:27.221864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacc14f-cb92-4943-a293-8699a2818488 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.258411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.259229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.259542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.259888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.263649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 426/869] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:27.267118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:27.268617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:27.274785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:27.281520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:27.286070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:27.286981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:27.287928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 444/870] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:27.294450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:27.297983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:27.395373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7379b9-86e5-4a06-99e0-e6d50b415c26 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.430313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df641-74b8-4906-a520-d0f2f6436786 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.434802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.435740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.436122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.436497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.437338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:27.438837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:27.459374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 427/871] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:27 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:27.484741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.485458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.485744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.486020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.486823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:27.487138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:27.488691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50790e-ae8b-4d69-8c0b-4ddbd006a422 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:27.502885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 445/872] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:27.508985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:27.585701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:27.626933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9ad4-3754-4752-8fdb-2aedb9b0bf97 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.665133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.666027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.666446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.666853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.667987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=c2660c54018042e5af8535a2b7b5e9af) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:27.668432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:27.670011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f760e-b484-4d9a-8419-ee74bec01b5f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:27.676903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 428/873] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:27 2022] GET /identity/v3/role_assignments?user.id=c2660c54018042e5af8535a2b7b5e9af&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:27.680187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ce6e-f598-4f23-a533-91b4eb516525 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.680476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ce6e-f598-4f23-a533-91b4eb516525 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.680752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ce6e-f598-4f23-a533-91b4eb516525 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.682305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 446/874] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:27.688030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.688315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.688588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.709327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:27.710850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:27.785384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 429/875] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:27.810053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ce6e-f598-4f23-a533-91b4eb516525 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:27.876519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:27.925267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ce6e-f598-4f23-a533-91b4eb516525 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:27.961383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:27.962258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:27.962542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:27.962815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:27.974283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:27.982733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:27.983765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:27.984807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 447/876] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:27.991500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.054556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:28.099865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a2fc-0b75-418e-8594-0da477ea4756 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.140299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.140977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.141262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.141550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.142299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:28.142713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.144140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.153141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 430/877] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:28.160235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.266307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6a4a2-65b9-404f-a9d9-d8538e67623d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.282953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:28.301967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.302770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.303052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.303326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.314573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.316049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:28.333513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:28.334431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:28.335380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:28.335380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:28.335380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:28.335380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:28.335380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 448/878] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:28.341050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.441981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e759045-3de8-434d-9d4e-da965791ed4a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.466590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:28.479051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.480056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.480516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.480961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.481876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:28.482357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.484055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b6a1d-3ede-4ea2-871e-1f69093359e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.497402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 431/879] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:28.503025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.546961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5bb1-e909-4859-a900-48597a8154c6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.547210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5bb1-e909-4859-a900-48597a8154c6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.547485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5bb1-e909-4859-a900-48597a8154c6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.552602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 432/880] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:28.554230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.554520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.554808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.571819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:28.573004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:28.612701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb5226-32a4-4d56-a84a-3ee1be399fb5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.654555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 433/881] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:28.663420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.663420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.663420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.663420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.665434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.667037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.676906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:28.682113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:28.683316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:28.684312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 449/882] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:28.690730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.722213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:28.783909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dff93-01bd-4bf6-968f-9ee0d1f1d563 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.799965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc8ba-cb00-40a7-8040-27f990d5ce70 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:28.801413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:28.821149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.822134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.822847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.823324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.824545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.826232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.837941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:28.838568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:28.838849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:28.839202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:28.840122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:28.840748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:28.842364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:28.843787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 434/883] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:28 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:28.865162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 450/884] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:28.870982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:28.988442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b109-df8b-495a-9ca3-02523b0174ce None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.031143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.031830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.032112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.032375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.077608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:29.119029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.120826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.221548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 435/885] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:29.227128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.313093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:29.329195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7970ae3-8c3f-4b8c-a874-f78dc7ce43f7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.368332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.369131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.369409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.369682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.380259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.381719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-3f457aac-eba1-48ff-846f-69fba141d395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:29.400007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:29.400947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:29.401990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:29.401990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:29.401990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:29.401990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:29.401990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 451/886] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:29.408016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.479874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:29.516439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1760-cbc3-40be-a875-5c6e12d371db None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.547310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b692fd-6510-43df-87da-a9ef125cf28f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.547639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b692fd-6510-43df-87da-a9ef125cf28f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.547904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b692fd-6510-43df-87da-a9ef125cf28f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.549523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 452/887] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:29.551767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.552458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.552726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.553079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.553819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:29.554131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.554566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.554951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.555362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.555544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.568664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 436/888] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:29.574208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:29.575433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:29.576527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.670153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 453/889] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:29.686192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb0cb1-3197-4361-bd7c-0f226d84d916 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.692478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.715115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:29.721177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.721993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.722593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.722848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.730563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.732367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:29.747355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:29.748487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:29.749622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:29.750855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 437/890] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:29.756421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.771979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:29.813129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b56943-9d08-44d3-b633-65d9bccceda0 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.855506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.856480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.856863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.857233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.857989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.859552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:29.872132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:29.873250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:29.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:29.878923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 454/891] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:29.879856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.882057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302693-f6e5-461b-82c4-3a4c5ffcadfa None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:29.928842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:29.929461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:29.930016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:29.930297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:29.931367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:29.931682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:29.933671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:29.946759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 438/892] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:29.952607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:29.993934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bea4-1d89-455c-872a-76bbfd234f8d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.006106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.026615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.033112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.033788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.034071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.034777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.035521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.035833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.037895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ffb7d-7a1b-4fc2-aa0a-baa49664be8e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.047919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 455/893] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:30.047919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5be2-059b-4857-a199-7c3524c2662c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.047919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5be2-059b-4857-a199-7c3524c2662c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.047919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5be2-059b-4857-a199-7c3524c2662c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.047919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 456/894] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:30.051794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5be2-059b-4857-a199-7c3524c2662c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.068292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554bdc-ee8a-4ce6-98c3-a928b9503372 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.108554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.109226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.109514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.109791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.110623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] RBAC: Adding query filter params (role.id=1b25a8853f8d4151abe165c98ff80882, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=40e26487f27e4a0c81cfbf3cbe229045) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.110943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.112446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161f16-f744-4b12-966b-0fe84ceedae2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.118248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 439/895] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:29 2022] GET /identity/v3/role_assignments?user.id=40e26487f27e4a0c81cfbf3cbe229045&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=1b25a8853f8d4151abe165c98ff80882 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:30.119447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.119743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.120020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.138355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:30.139655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:30.195131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5be2-059b-4857-a199-7c3524c2662c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.221069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 440/896] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:30.245623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.247687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.248468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.248822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.249167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.250103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.250480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.252185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.258112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 457/897] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:30.263895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.300487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.350622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.361717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79f67-6519-48ae-b65b-f5e857930731 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.391570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf7142-e67c-4003-b5d7-6734a3397ac7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.398118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.399314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.399858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.400328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.401211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.402893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:30.415644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:30.416662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:30.417579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:30.425439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 441/898] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:30.426123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.430231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.430911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.431973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.431973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.432273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] RBAC: Adding query filter params (interface=public, service_id=2a5c48771bd74bb9bc742e1feb3f4ff9, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.432587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.434012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.444040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 458/899] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/endpoints?service_id=2a5c48771bd74bb9bc742e1feb3f4ff9&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:30.445309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.535422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665fa2-5e3f-4830-bec8-767437a39164 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.545573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.546469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2a2a-098e-4919-a238-62b21bc368f5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.572152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:30.575006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.575943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.576451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.577070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.577987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.578490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.580309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.584120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.584818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.585095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.585342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.586034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.587452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754f38-b080-472b-8794-74e5cdac2a42 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.593332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 442/900] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:30.595045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:30.603707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 459/901] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:27:30.709851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0055c0-499c-4752-a21d-0a6353505706 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:30.747870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:30.748943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.749463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.749952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.751050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:30.751576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:30.753178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8fcc6-8164-4168-bbd2-70539cf09885 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:30.758668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 443/902] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:30.988452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb060-296b-4a22-b21d-691a8198ea76 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.988802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb060-296b-4a22-b21d-691a8198ea76 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.988976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb060-296b-4a22-b21d-691a8198ea76 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:30.990546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 460/903] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:30.995754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:30.996190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:30.996370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.013248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:31.014433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:31.043410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:31.085826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 444/904] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:31.109534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb060-296b-4a22-b21d-691a8198ea76 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:31.216260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb060-296b-4a22-b21d-691a8198ea76 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:31.254936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:31.256603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:31.257091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:31.257582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.258434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:31.260053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:31.274133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:31.275834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:31.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:31.280278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 461/905] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 23 13:27:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:31.288394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:31.390906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0c114-2ab4-49fa-9ca7-a3cc57759b1c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:31.425427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:31.426101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:31.426378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:31.426698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.427429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:31.427773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:31.429178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:31.434292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 445/906] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:31.439703 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:31.495592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:31.543741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6cf4-8ab9-4e5a-94f5-61615b88e0f4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:31.577753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:31.578777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:31.579292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:31.579826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.580747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:31.581255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:31.582901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:31.588790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 462/907] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:31.597335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:31.624980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:31.698256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e4d1-bb22-4896-bc68-54020d4f69f0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:31.733489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:31.734521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:31.735007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:31.735515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.736530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] RBAC: Adding query filter params (interface=public, service_id=01073d2e4ac3403b9e04ecb568eb4769, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:31.737064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:31.738656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d329da-7682-4caf-92bc-63e3338e344a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:31.746907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 446/908] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:31 2022] GET /identity/v3/endpoints?service_id=01073d2e4ac3403b9e04ecb568eb4769&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:31.754488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:31.856409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a041878-9664-4e47-a18b-0a388654a40d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:31.872706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:31.892746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:31.893410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:31.893689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:31.893961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:31.894635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:31.896132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688289b-c8f7-4c84-a981-5dd889a38dcb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:31.902372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 463/909] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:31 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:27:32.204335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466bdf-0046-465c-b968-ab6f42f960e4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.204846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466bdf-0046-465c-b968-ab6f42f960e4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.204925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466bdf-0046-465c-b968-ab6f42f960e4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.206526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 447/910] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:32.211789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.212082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.212364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.232357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:32.233542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:32.304835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 464/911] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:32.326927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466bdf-0046-465c-b968-ab6f42f960e4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:32.423915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:32.431320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466bdf-0046-465c-b968-ab6f42f960e4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:32.466547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:32.467390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.467673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.467945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.478825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:32.487054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:32.488011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:32.489011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 448/912] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:32.494303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:32.597965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275139-6c78-403c-a33f-96dec8ab4d10 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:32.608995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:32.634118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:32.634783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.635062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.635343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.636168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:32.636469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:32.637832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9e1b7-eff6-4b1e-b440-747977e191b1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:32.646367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 465/913] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:32.651971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:32.753086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a2bd-e361-408a-8383-0370ae523ab3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:32.791180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:32.792218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.792495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.792805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.802973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:32.804471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:32.818065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c4cb-64b0-4ed8-8420-a7243e27f2cf None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.818649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c4cb-64b0-4ed8-8420-a7243e27f2cf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.819130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c4cb-64b0-4ed8-8420-a7243e27f2cf None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-343ad5f6-ae63-41cd-95cf-c91da771cf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:32.824527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:32.825714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:32.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:32.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:32.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:32.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:32.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 449/915] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:32.827288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 466/915] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:32.829227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb723-6897-418d-90d1-b914f2d1519a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.829521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb723-6897-418d-90d1-b914f2d1519a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.829796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb723-6897-418d-90d1-b914f2d1519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.830605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c4cb-64b0-4ed8-8420-a7243e27f2cf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:32.847049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2f8eb723-6897-418d-90d1-b914f2d1519a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:32.848268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f8eb723-6897-418d-90d1-b914f2d1519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:32.851493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:32.916789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 450/916] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:32.918239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b8fbe-bbe0-48b2-bda8-cec10da26dd8 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.918528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b8fbe-bbe0-48b2-bda8-cec10da26dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.918799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b8fbe-bbe0-48b2-bda8-cec10da26dd8 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.920316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 451/917] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:32.925262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.925647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.926018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.940360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c4cb-64b0-4ed8-8420-a7243e27f2cf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:32.949043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:32.950679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:32.979813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:32.980496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:32.980757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:32.981028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:32.981744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:32.982094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:32.983555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.000735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 467/918] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:33.000735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.035601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 452/919] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:33.035601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.036959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.116200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01260-7cd2-482a-853f-fb716bb7c939 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.117825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.153309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.154112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.154387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.154656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.154987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744228-306a-48a6-9b77-9dbdfb849cff None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.155297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.156679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:33.169203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:33.175249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:33.176329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 468/920] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:33.177317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.198435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.199199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.199505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.199817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.207190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.210725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:33.226733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:33.227798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 453/921] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:33.233670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.281349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.288084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8436-28ea-46ed-9e2e-68df439dcdbe None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.327522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.328171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.328385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.328620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.329342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.330716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.351791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 469/922] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:33 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:33.351791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.354869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b8d9-507d-4320-8de1-6c66b2a7e1e4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.395144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.417666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.419399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.419847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.420275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.421423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:33.422370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.424555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.432268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 454/923] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:33.437904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.499136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee953b-f01f-403a-8f4c-85bc6c1ae77b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.547751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.548796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.549262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.549719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.550847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:33.551359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.553033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.572520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 470/924] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:33.578237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.581088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29e16-767c-485f-a94d-4072827aca86 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.597751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.620666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.621346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.621625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.621891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.622847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:33.623175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.624579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.630445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 455/925] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:33.636114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.685944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92658e-6959-4e82-9d7a-65fbaa889124 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.702350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.730293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.731540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.732065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.732532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.747482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.749764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.759044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a4d4d-1f0b-4b77-82f2-061ce6b6af61 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:33.774837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:33.775875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:33.776908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:33.776908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:33.776908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:33.776908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:33.777148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 471/926] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:33.787369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:33.801148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.801749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.802079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.802355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.803151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.804669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799447e-2010-4306-9fc4-af69401f1b22 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.826075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 456/927] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:33.864155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:33.904801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45454-4708-4545-9a8c-54691b674390 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:33.937328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62ab5-b589-4fe6-9b1c-6c0302227015 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.937729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62ab5-b589-4fe6-9b1c-6c0302227015 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.938057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62ab5-b589-4fe6-9b1c-6c0302227015 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.939757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 457/928] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:33.948816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:33.949069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.949348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.949468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:33.949737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:33.949850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.950006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:33.950732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:33.951028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:33.952521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:33.966139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 472/929] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:33.969004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:33.970233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:33.971373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.054091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 458/930] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:34.077053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.087925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3edd-c39e-409a-988f-a016d1e35db0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.116062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:34.123195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:34.134353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.135295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.136157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.139921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.153551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.156024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:34.172321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:34.174087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:34.175270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 473/931] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:34.179038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.206963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ace77-db56-411e-9a6f-df7229635f00 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.256424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.258780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.259262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.259758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.260905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.263645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:34.279843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:34.280911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:27:34.281782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:34.285150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 459/932] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 23 13:27:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:34.290504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.300891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e697-b9be-4905-9113-2f6080cab39b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.343580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.345037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.345530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.346007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.347011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:34.347560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.349227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.363485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 474/933] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:34.375356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.389044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:34.392158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7de7-1d6e-4142-a9c8-f5927aec199a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.429793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:34.433601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.434283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.435185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.435707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.436804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:34.437116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.438516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.446099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 460/934] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:34.451619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.492615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fcb61-345d-4047-8795-246d2d0eeab9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.541111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.542698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.543106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.543508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/40e26487f27e4a0c81cfbf3cbe229045/roles/1b25a8853f8d4151abe165c98ff80882` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.547007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=40e26487f27e4a0c81cfbf3cbe229045, role_id=1b25a8853f8d4151abe165c98ff80882)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.549276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.569012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4fbde-25ed-4167-9251-847b4707d3e1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.571424 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 475/935] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:34 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/40e26487f27e4a0c81cfbf3cbe229045/roles/1b25a8853f8d4151abe165c98ff80882 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:34.615445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.616225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.616510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.616786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.617590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:34.617999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.619602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b604-f8f9-4d20-b881-0a38f32b567a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.626225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 461/936] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:34.632140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:34.750352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2312-fee7-43c2-97d7-beeaa561f801 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:34.751983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:34.792690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:34.793351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:34.793627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:34.793894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:34.794634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:34.796723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbc437-3151-4e1f-a5b8-1af39c3a3098 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:34.819024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 476/937] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:35.546981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa7-93f9-49cf-99b8-7b1b5214c7b4 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.547566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa7-93f9-49cf-99b8-7b1b5214c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.547566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa7-93f9-49cf-99b8-7b1b5214c7b4 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.549305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 462/938] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:35.554935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.555419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.555505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.572968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:35.574229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:35.655415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 477/939] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:35.671387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5aa7-93f9-49cf-99b8-7b1b5214c7b4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:35.700681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:35.779707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5aa7-93f9-49cf-99b8-7b1b5214c7b4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:35.816516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:35.817578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.818007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.818412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.819444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:35.821163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-92bfa2f1-9823-4bb6-9b12-7de66968b6d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:35.834523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:35.835922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:35.837116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:35.839596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 463/940] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:35.845825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:35.933799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:35.952496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac67076-15c2-4ab0-b4e1-cd149a7df623 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:35.974479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f101c2c-bdb9-4a7d-b6fb-4a9353aafc95 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.975036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f101c2c-bdb9-4a7d-b6fb-4a9353aafc95 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.975525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f101c2c-bdb9-4a7d-b6fb-4a9353aafc95 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.978186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 464/941] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:35.983781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.984308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.984777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.993752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:35.994414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:35.994698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:35.995007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:35.995866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:35.996171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:35.997536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.002779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 478/942] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:36.004540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:36.005940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:36.008254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.087663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 465/943] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:36.115898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.125055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faaf2-392f-4ff5-9c96-2a3c73337953 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.140836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:36.170008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.170684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.170968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.171248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.172428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:36.172742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.174404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.183472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 479/944] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:36.188155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.205957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:36.232425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359dc79-3fd4-4e81-b3f5-529837deab70 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.281319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.282000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.282286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.282556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.283703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.285449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.287442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING keystone.server.flask.common [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 13:27:36.302125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032365-01a0-4612-bc22-552ae6c84740 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.311716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.sql.core [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:27:36.311716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 13:27:36.311716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [parameters: {'id': '63524af143404c7aba2034a7abe56a20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 13:27:36.311716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63524af143404c7aba2034a7abe56a20.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63524af143404c7aba2034a7abe56a20. Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:27:36.320213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 13:27:36.321049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application yield resource Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise self.value Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application session.commit() Jun 23 13:27:36.322001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:27:36.322953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:27:36.323945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application result.read() Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:27:36.326447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [parameters: {'id': '63524af143404c7aba2034a7abe56a20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:36.328584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:36.330435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63524af143404c7aba2034a7abe56a20. Jun 23 13:27:36.332552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.340596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 466/945] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 23 13:27:36 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:36.341638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.345758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.346429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.346716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.347280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.348119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] RBAC: Adding query filter params (interface=public, service_id=a0c50a1da067402883e4b344383d1a3c, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:36.348426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.350887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.361557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 480/946] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/endpoints?service_id=a0c50a1da067402883e4b344383d1a3c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:36.364388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.450610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:36.452459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:36.478234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c10ab-d864-4831-aff1-eedf84eb3cd2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.479994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e3e-c5be-4bd6-8962-9c35da684573 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.513794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.514967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.515488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.515954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.522701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.523537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.523825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.524102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.524455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.524786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.526162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.526888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.539364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 481/947] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-be90e376-78d7-4f40-bc91-7eeaef11edf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:36.543772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:36.544700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:36.545577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 467/948] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:36.552321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.668238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7fee-12af-41ce-9df9-06a27f5e051f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.708864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:36.709523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.709808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.710069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.710825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:36.711127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:36.712588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:36.725121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f441-189f-479b-9b71-9f6d2c12e77e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.725640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f441-189f-479b-9b71-9f6d2c12e77e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.725738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f441-189f-479b-9b71-9f6d2c12e77e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.727456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:36.730147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 468/949] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:36.731602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 482/950] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:36.736320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059cd1-a8bc-45dc-abb5-b69dda4b996b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.736906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059cd1-a8bc-45dc-abb5-b69dda4b996b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.737434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059cd1-a8bc-45dc-abb5-b69dda4b996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.756962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-59059cd1-a8bc-45dc-abb5-b69dda4b996b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:36.758537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-59059cd1-a8bc-45dc-abb5-b69dda4b996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:36.836745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 469/951] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:36.860740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:36.883082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820c6f-89c6-4d9e-bf8d-772e0a2d9d09 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.883452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820c6f-89c6-4d9e-bf8d-772e0a2d9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.883677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820c6f-89c6-4d9e-bf8d-772e0a2d9d09 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.885215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 470/952] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:36.892268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:36.892563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:36.892942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:36.916094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:36.917683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:36.985702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799432-91f8-4223-b0ce-15d3f027659a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:36.998029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.005300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 471/953] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:37.023240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.024373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.024790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.025229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.033377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.036806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:37.045456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:37.046623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:37.047787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 483/954] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:37.052746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.124593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.157464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e32e-935f-4684-97b0-412bc9ea6722 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.174758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5240-910b-43e3-9eb8-a968816b4d66 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.204626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.205595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.205881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.206181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.207393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.208778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.211744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.212623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.213051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.213467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.214405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:37.214852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.216695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:37.222018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:37.223427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:37.225593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 472/955] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:37.229301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.234173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 484/956] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:37.241047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.307285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.355371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec4f0-86ab-49f7-8f90-4522df7f7fc5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.363152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10221ed-52c5-46ff-a0ee-aecf341d0dcf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.391426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.395933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.397253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.398410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.399376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.400493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:37.401044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.402837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.404107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.405080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.405652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.405941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.410074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 473/957] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:37.416657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.418377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.420023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:37.443797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:37.444736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:37.445702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:37.445702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:37.445702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:37.445702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:37.447416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 485/958] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:37.451771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.524558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f11bf-0d3d-40a9-b05c-5ff84dd04b1f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.551865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.554806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f479-4417-4d02-a2b8-2de00145f04f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.560035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.560641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.560929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.561206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.562251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:37.562831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.564583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.569829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 474/959] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:37.600769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.601457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.601739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.602075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.603104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:37.603448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.605259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.619494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 486/960] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:37.625439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.736458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb985-a75c-4870-90bb-6ac4c0957b20 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.774099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354866-dada-400e-8b7a-436123678472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.775402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354866-dada-400e-8b7a-436123678472 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.775889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354866-dada-400e-8b7a-436123678472 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.776436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354866-dada-400e-8b7a-436123678472 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.784861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354866-dada-400e-8b7a-436123678472 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.786563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7354866-dada-400e-8b7a-436123678472 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c7354866-dada-400e-8b7a-436123678472 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:37.801873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:37.802878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:27:37.803879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:37.806509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 475/961] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:37.811990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:37.848559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:37.918271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd7-c773-485b-b6f4-1b88faf568a5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:37.952733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:37.953404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:37.953684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:37.953955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:37.954790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:37.955097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:37.956561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:37.974476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 487/962] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:37.980237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354866-dada-400e-8b7a-436123678472 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.032466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:38.086544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7354866-dada-400e-8b7a-436123678472 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.122003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.122884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.123172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.123477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.192413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.193902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.243197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:38.297082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 476/963] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:38.302486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.396493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:38.405571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bade-27f9-4173-b527-c48b1ad1cf87 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.440265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.441056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.441337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.441610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.451853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.453361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:38.471207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:38.472148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:38.473053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:38.473053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:38.473053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:38.473053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:38.473053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 488/964] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:38.480451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.578768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c8da-25fd-4a47-8516-3807178ec40f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.615210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.616288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.616771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.617241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.618180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:38.618704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.620359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c5cb-f712-40e9-993a-d8fc082bea89 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.632935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 477/965] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:38.638840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.659464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aeac0-0af8-49c0-83d1-2f1b296ada2c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.659811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aeac0-0af8-49c0-83d1-2f1b296ada2c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.660130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aeac0-0af8-49c0-83d1-2f1b296ada2c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.661931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 478/966] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:38.667601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.667897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.668187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.687026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:38.688558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:38.697823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:38.760092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f30bb-ceaa-4d04-a8d9-47423bcc2d51 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.774155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 479/967] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:38.797252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.803300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.804410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.804906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.805387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.813375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.815649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:38.831238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:38.832287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:38.833217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:38.835918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 489/968] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:38.842395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.846750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:38.921089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439413-ff93-4ce5-8579-7e24ad8a49cf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.949228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cb9c-5fa8-4e18-b8ff-aa216c918585 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:38.966109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.966960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.967247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.967546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.968453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.970227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:38.986521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:38.987599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:38.988439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:38.990334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:38.991227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:38.991731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:38.992198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:38.992784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 480/969] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:38.993698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:38.994265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:38.994790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:38.996644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:38.997378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.013596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 490/970] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:39.019687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.087393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.119609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aebea-c589-4fa0-a99b-d581594f012e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.133899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cea4f0-8dea-47a2-b7ed-6263d877f0da None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.154662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.155358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.155667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.155948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.156666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:39.156982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.158379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bee99-911d-4d4d-a0b6-6742830bc967 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.168526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 481/971] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:39.168526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5a18-0338-4341-a19c-1dd5edb5f55d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.168526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5a18-0338-4341-a19c-1dd5edb5f55d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.168526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5a18-0338-4341-a19c-1dd5edb5f55d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.168526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 482/972] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:39.169577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5a18-0338-4341-a19c-1dd5edb5f55d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.180069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.180731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.181004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.181487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.182108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] RBAC: Adding query filter params (role.id=1b25a8853f8d4151abe165c98ff80882, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=40e26487f27e4a0c81cfbf3cbe229045) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:39.182437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.184126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d7be-753a-415b-babb-849ba14f72c7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.195368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 491/973] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:39 2022] GET /identity/v3/role_assignments?user.id=40e26487f27e4a0c81cfbf3cbe229045&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=1b25a8853f8d4151abe165c98ff80882 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:39.195368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.195368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.195368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.219940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:39.221521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:39.257223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.298540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5a18-0338-4341-a19c-1dd5edb5f55d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.319870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 492/974] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:39.347029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.351540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.352528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.353017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.353519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.354549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:39.355065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.356921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.363484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 483/975] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:39.369807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.422609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.467478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89bc8-b08c-410b-97ed-761130219310 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.489113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61eb4-28fb-49f9-8b1c-ddec1bb09511 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.503654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.504326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.504704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.504981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.505701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.507214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.508655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING keystone.server.flask.common [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 13:27:39.522850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.sql.core [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:27:39.522850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 13:27:39.522850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [parameters: {'user_id': '495bf0d1060440e5b2a8fb59a2f2e009', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 13:27:39.522850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:27:39.523735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.530059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.530935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.531399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.531771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.532681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.534250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626f04-835c-4c5b-8792-9150f58e46c6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jun 23 13:27:39.541773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:27:39.542905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application yield resource Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise self.value Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application session.commit() Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:27:39.544095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:27:39.545215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:27:39.546133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application result.read() Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:27:39.547006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [parameters: {'user_id': '495bf0d1060440e5b2a8fb59a2f2e009', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:39.549343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 13:27:39.551575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 493/976] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 23 13:27:39 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:39.553743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.572590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 484/977] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:39.666263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e89ba-3be3-46b3-b576-f945d0cbc848 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.666693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e89ba-3be3-46b3-b576-f945d0cbc848 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.667097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e89ba-3be3-46b3-b576-f945d0cbc848 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.668924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 485/978] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:39.679364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.679364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.679364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.679731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8efe33-98d9-4bf4-9b8f-96a28d7b2d1e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.699764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:39.701541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.703532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:39.731293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.732329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.732451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.732676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.742159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.743925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:39.762120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:39.763114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:39.764141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 494/979] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:39.769595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.805600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 486/980] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:39.828591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:39.886519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82a0d-3aca-40d8-ab8e-18825aacc8b9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.925418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.926564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.927089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.927590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.928699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:39.929222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.930978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebefb85-ef60-49aa-ba61-d00f496f2d69 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:39.953218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a6d1-bdea-4596-abff-ea082197ef63 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:39.972568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 495/981] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 23 13:27:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:39.973429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:39.993092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:39.993771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:39.994065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:39.994677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:39.995510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:39.997234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6724dc0-cf27-42b3-a546-db4e0abdad08 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:40.015056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 487/982] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:39 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:41.347321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9619b2-60ff-49c6-a5ab-02595e14fab1 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.347879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9619b2-60ff-49c6-a5ab-02595e14fab1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.347879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9619b2-60ff-49c6-a5ab-02595e14fab1 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.349282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 496/983] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:41.354698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.355105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.355269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.372797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:41.373915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:41.452102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 488/984] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:41.474179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9619b2-60ff-49c6-a5ab-02595e14fab1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:41.512260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:41.581398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9619b2-60ff-49c6-a5ab-02595e14fab1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:41.617566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:41.618499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.618779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.619035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] PATH_INFO: `/v3/services/image` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.619712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:41.621230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ebe45a77-bdaf-4b12-8361-77ba038c4f7d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:41.633272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:41.634351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:41.635192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.639453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 497/985] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 23 13:27:41 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:41.643586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:41.643725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a47a1-2b00-40b0-8fdd-a54fd8c0bf31 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.643725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a47a1-2b00-40b0-8fdd-a54fd8c0bf31 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.643725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a47a1-2b00-40b0-8fdd-a54fd8c0bf31 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.643725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 498/986] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:41.648767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.649055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.649336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.666550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:41.668206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:41.741285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 499/987] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:41.751480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2725d1-1c30-44ca-8a7a-4aa635b6398c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:41.754726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:41.764383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:41.792272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:41.795657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:41.796391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.796669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.797015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.797642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] RBAC: Adding query filter params (name=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:41.797947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:41.799325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:41.805032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 489/988] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:41.810372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:41.870244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649713-b827-46f8-b900-48bc2ee6a144 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:41.907356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:41.908627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.908914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.909186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.909842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:41.911447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:41.914178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd4ab1-6813-4190-a26a-a4a465219426 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:41.923749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:41.924779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:41.925841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 500/989] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:41.930873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:41.955324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:41.955988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:41.956267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:41.956538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:41.957245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] RBAC: Adding query filter params (type=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:41.957550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:41.958924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f61d4-bfda-4126-887e-6a03e4954cba None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:41.971363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 490/990] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:42.042931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.044055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7e5c-dc88-457c-851f-8b6a837c9c87 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.044456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7e5c-dc88-457c-851f-8b6a837c9c87 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.044746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7e5c-dc88-457c-851f-8b6a837c9c87 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.046360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 491/991] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:42.052235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.052675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.053049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.054547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaad2-7292-4456-84e0-e640801a8a0f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.070809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:42.072184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:42.094781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.095775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.097267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.097710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.098581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.098782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.100246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.102465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.106170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 501/992] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:42.111924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.159486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 492/993] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:42.177800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.220407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa9dc-0d03-4d17-90b8-64a5cf7e7e89 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.260035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.260912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.261285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.261749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.262518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.262767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.264247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.269473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 502/994] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:42.274969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.285482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a425f7-42bf-4066-b9ef-58712e3c7bdf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.297250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.325111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.326234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.326917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.327196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.327879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.329750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:42.345623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:42.346625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:42.347499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 493/995] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:42.352623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.383053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.383698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db981a0-bd85-4e98-9b95-8a0d3ee5f642 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.418974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.419550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.419836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.420101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.420904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] RBAC: Adding query filter params (interface=admin, service_id=a0c50a1da067402883e4b344383d1a3c, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.421235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.422679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.428079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 503/996] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/endpoints?service_id=a0c50a1da067402883e4b344383d1a3c&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:42.433270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.463979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fbd3f-d8da-4885-802f-22c07031cabb None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.498480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.499151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.499481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.499734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.500432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.500732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.502110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.507422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 494/997] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:42.513200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.518783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.535601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8395d-24f8-48ca-a766-7dd722af710c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.571620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.572248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.572525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.572791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.573571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.574927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.581405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 504/998] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:27:42.609694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:42.621138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cabac-024c-439c-8702-a9ca40da2fb1 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.659246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.660059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.660412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.660757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.661552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.661932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.663450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.669797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 495/999] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:42.675484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.783474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d902c-ae22-44e8-a9b6-a5892f8bc0c5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.816375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.817023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.817300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.817568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.818350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] RBAC: Adding query filter params (interface=public, service_id=d1ef9c0bf0184e94a8df2d563da9aa9d, region_id=RegionOne) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:42.818654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.820041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376482c3-2028-4287-bc37-8cd3e65c20a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.830404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 505/1000] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/endpoints?service_id=d1ef9c0bf0184e94a8df2d563da9aa9d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:42.832153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:42.932711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb39fcd-5c54-4e2a-8053-c403c2c383bf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:42.967753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:42.968488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:42.968837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:42.969238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:42.969973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:42.971466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22afee7-91e5-435f-ad74-580fdbdfc126 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:42.977999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 496/1001] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:42 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:27:43.983898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe212-1a97-457b-aa85-4269afadad80 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:43.984442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe212-1a97-457b-aa85-4269afadad80 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:43.984442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe212-1a97-457b-aa85-4269afadad80 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:43.985793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 506/1002] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:43.991197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346f78-9420-45e7-b0d6-4369ebcb22b7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:43.991697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346f78-9420-45e7-b0d6-4369ebcb22b7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:43.991777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346f78-9420-45e7-b0d6-4369ebcb22b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:44.009184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-70346f78-9420-45e7-b0d6-4369ebcb22b7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:44.010374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-70346f78-9420-45e7-b0d6-4369ebcb22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:44.024163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:44.083862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 497/1003] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:44.106907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fe212-1a97-457b-aa85-4269afadad80 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:44.123101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:44.216171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fe212-1a97-457b-aa85-4269afadad80 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:44.251209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:44.251808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:44.252084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:44.252348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:44.253075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:44.254625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fa967-f8c2-46c9-bcba-3c39f7221f40 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:44.275372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 507/1004] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:44 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:44.630513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84732a7-d820-45e0-b905-66c5334492bc None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:44.630705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84732a7-d820-45e0-b905-66c5334492bc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:44.630949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84732a7-d820-45e0-b905-66c5334492bc None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:44.632571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 498/1005] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:44.637801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:44.638168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:44.638517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:44.655906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:44.657111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:44.729112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:44.737650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 508/1006] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:44 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:44.761097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84732a7-d820-45e0-b905-66c5334492bc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:44.869276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84732a7-d820-45e0-b905-66c5334492bc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:44.909359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:44.910179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:44.910462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:44.910736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:44.911424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:44.912808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-349117f6-47df-4835-ba29-400f86a1e5ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:44.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:44.926226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:27:44.927102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:44.928672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 499/1007] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 23 13:27:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:44.932516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:44.998484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b230f-69a0-40fa-bcb8-b772d5c33257 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:44.999010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b230f-69a0-40fa-bcb8-b772d5c33257 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:44.999010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b230f-69a0-40fa-bcb8-b772d5c33257 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.000721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 500/1008] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:45.005804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.006047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.006355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.023551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:45.024846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:45.033163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:45.037350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa456b-9ea6-4fe7-8556-0b77bbee4ba5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.073231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.074057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.074337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.074613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.075318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:45.075647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.077070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.086477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 509/1009] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:45.087586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.106938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 501/1010] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:45 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:45.129752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.153763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:45.192531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bcd48-e1c6-4b26-bc1f-135893547ed0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.228160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.229201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.229490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.229914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.231134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:45.231595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.233466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.234650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6370-5d38-40aa-991b-639eda755084 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.240268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 510/1011] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 23 13:27:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:45.245989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.272371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.273185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.273473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.273775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.274411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.276094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:45.287852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:45.288824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:27:45.289671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:45.291693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 502/1012] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:45.294850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.306085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:45.352102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c0a4-cd67-4ff4-a650-75f43adfae8c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.379578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:45.388927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.389583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.389860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.390131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.390870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.392262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.404781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269235-1b66-4043-a8f3-c7bccfe730f7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.408822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 511/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:45.451360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.452017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.452300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.452572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.453281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:45.453586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.455162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.466389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 503/1014] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:45.467720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.575254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74f28-672a-4435-aceb-724922fd7e3c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.610254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.611011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.611415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.611752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.612522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:45.612897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.614323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2865-d0e0-478e-b46c-9264e0ea8bcf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.619653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 512/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 23 13:27:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:45.625491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:45.691161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:45.729757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63bbee-6278-499d-bd9e-fa11d122da84 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:45.764927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:45.765738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:45.766112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:45.766467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:45.767316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:45.768876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca4e21-e5fd-45cf-a597-8c864721483c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:45.792085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 504/1016] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:46.286230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da4e2-0169-42ba-87e9-d0dbfd976ebd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:46.286800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da4e2-0169-42ba-87e9-d0dbfd976ebd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:46.286800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da4e2-0169-42ba-87e9-d0dbfd976ebd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:46.288376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 513/1017] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:46.293570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:46.294004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:46.294104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:46.311072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:46.312284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:46.389976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 505/1018] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:46.416485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da4e2-0169-42ba-87e9-d0dbfd976ebd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:46.470289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:46.526465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da4e2-0169-42ba-87e9-d0dbfd976ebd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:46.561192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:46.561983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:46.562309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:46.562582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:46.563278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:46.564684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:46.576603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:46.577660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:46.578624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:46.582966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 514/1019] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 23 13:27:46 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:46.584091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:46.634908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:46.689288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7bf3-864b-4c03-89c4-5b72160aca2c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:46.726544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:46.727207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:46.727517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:46.727795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:46.728497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:46.728802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:46.730343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:46.735530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 506/1020] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:46.741220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:46.845104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7819-48b0-4dc7-8f32-def9a2dcacb5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:46.859013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:46.880365 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:46.881020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:46.881314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:46.881590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:46.882294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] RBAC: Adding query filter params (type=image) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:46.882602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:46.884016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:46.889251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 515/1021] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:46.894983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:47.001824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b8424-d574-451b-bd7a-d9ba63aaf0c2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:47.016319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:47.040570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:47.041250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.041683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.041967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.042822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] RBAC: Adding query filter params (interface=public, service_id=9d2d9b461e3c497a93d4c7a0a16785f5, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:47.043142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:47.044574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb96ea-c7c8-4cab-8979-876c7b665935 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:47.054420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 507/1022] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:27:46 2022] GET /identity/v3/endpoints?service_id=9d2d9b461e3c497a93d4c7a0a16785f5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:47.055675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:47.170435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff4cd-d855-43d3-aec7-074bce814bfc None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:47.203903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:47.204572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.204851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.205130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.205816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:47.207180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9fe2c-f82f-49c3-a1a4-17975566bc19 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:47.213992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 516/1023] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:27:47 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:27:47.427347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4342f38-e132-48a9-bb06-b104e1ab1301 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.427875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4342f38-e132-48a9-bb06-b104e1ab1301 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.427985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4342f38-e132-48a9-bb06-b104e1ab1301 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.429301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 508/1024] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:47.434913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.435360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.435554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.452136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:47.453327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:47.491213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:47.525107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 517/1025] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:47.548300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4342f38-e132-48a9-bb06-b104e1ab1301 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:47.653139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4342f38-e132-48a9-bb06-b104e1ab1301 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:47.688936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:47.690061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.690536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.691016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.692392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:47.694065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008f12-6351-4919-b7f3-61e1c12104e1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:47.695913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 509/1026] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:47.701878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:47.805923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a310b-3276-41c9-9edb-1f0ab597ab25 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:47.846228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:47.846895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.847171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.847469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.848185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:47.849684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeab4c2-2ac9-4a3c-933a-8df68162ad24 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:47.883377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 518/1027] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:27:47 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:47.916291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fb15-5b78-4b01-a6a9-51233256b8ba None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.916627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fb15-5b78-4b01-a6a9-51233256b8ba None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.916910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129fb15-5b78-4b01-a6a9-51233256b8ba None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.918477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 510/1028] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:47.924032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:47.924333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:47.924594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:47.943087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:47.944235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:47.965749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:48.021710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 519/1029] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:48.045809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129fb15-5b78-4b01-a6a9-51233256b8ba None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.099179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:48.154647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129fb15-5b78-4b01-a6a9-51233256b8ba None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:48.188928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:48.189751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:48.190034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:48.190307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:48.200960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:48.209135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:48.210074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:48.210937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 511/1030] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:48.217025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.321065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d175-97b2-4eda-9a65-d7a0bf985d42 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:48.356612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:48.357286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:48.357561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:48.357834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:48.358576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:48.358883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:48.360285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:48.375376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 520/1031] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:48.376648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.481910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5016bfc-2318-4c50-a3e3-7e4ef2b9b338 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:48.484196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:48.517478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:48.518273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:48.518554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:48.518825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:48.529227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:48.530677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:48.547744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:48.548658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:48.549566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:48.549566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:48.549566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:48.549566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:48.549566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 512/1032] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:48.556109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.576370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:48.665602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a6e-766c-4f2d-96f9-cfd95123cab7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:48.703682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:48.704339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:48.704619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:48.704893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:48.705613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:48.705918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:48.707285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:48.724487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 521/1033] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:48.725704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.827457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e1c9-537e-4416-9d14-044ad26b5346 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:48.862623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:48.863727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:48.864213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:48.864659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:48.872647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:48.874308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:48.888754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:48.889727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:48.890699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:48.892659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 513/1034] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:48.898610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:48.979107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.003926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc65-a09a-413a-bd7e-b7c243e3dee9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.042133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.043049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.043478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.043788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.044642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:49.044952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.046395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c53c-4729-4551-a7ab-37092e83f586 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.068481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 522/1035] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:49.069799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.095218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.179963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61445-72f6-4bb1-b34f-13035098c325 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.213832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.214474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.214757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.215318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.219225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0110c-a458-4562-93d4-ae3652d0860b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.219564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0110c-a458-4562-93d4-ae3652d0860b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.219818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0110c-a458-4562-93d4-ae3652d0860b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.221368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 523/1036] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:49.226180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.226447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.226756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.244697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:49.245880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:49.291038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.292632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.310769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.325080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 524/1037] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:49.350100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.400279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 514/1038] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:49.405975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.416457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.455845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674197f8-806f-42ed-aff9-ab46b4297a9f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.492260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.493324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.493746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.494174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] PATH_INFO: `/v3/services/image` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.495026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.496568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.507587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a09c06-70ea-4939-a8ff-21dc9d01eb26 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:49.508939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:49.510174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:27:49.511271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:49.512629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 525/1039] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:49.518507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.526905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.545629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.546430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.546707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.547063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.557813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.558716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:49.576615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:49.577558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:49.579063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:49.579063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:49.579063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:49.579063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:49.579063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 515/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:49.583219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.627674 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d51ec3-10c2-4c63-852a-6585d254d69d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.656869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.666973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.667666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.667947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.668216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.668911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:49.669213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.670583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.675686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 526/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:49.680955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.687889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633e545-bd59-41d4-b59d-db62b2486e89 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.725203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.726149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.726635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.727186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.728228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:49.728708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.730399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.742988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 516/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:49.748292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.777139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.785089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508cf3a-7c93-4dea-bcb1-83763c9e43e0 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.818256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.818918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.819187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.819484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.820793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:49.820793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.822008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.828469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 527/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:49.833649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.857700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0412-f708-4c43-a3e6-b6a37785442b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.893344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.894136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.894415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.894688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.897052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:49.902204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.903671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:49.917833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:49.918847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:49.919794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:49.923964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 517/1044] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:49.924619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:49.944828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f7ea0-de3e-48d3-a7c7-0d60a1305c11 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:49.977969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:49.978627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:49.978946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:49.979228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:49.980003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:49.981381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b33d-88ba-4bee-b830-ec4b3cfb6182 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:50.001914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 528/1045] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:27:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:27:50.003155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c4d4e-0c5f-4b52-8910-59c8752d44bd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.003464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c4d4e-0c5f-4b52-8910-59c8752d44bd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.003733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c4d4e-0c5f-4b52-8910-59c8752d44bd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.005102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 529/1046] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:50.014255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:50.017385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.017955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.018351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.029261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85531f-6295-4974-a374-a63ddf6be3a2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:50.049056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:50.050595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:50.074238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:50.074919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.075198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.075501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.076306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:50.077140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:50.078631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:50.097990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 518/1047] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:50.098964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:50.137760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 530/1048] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:50.162155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:50.208920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322e14-09b1-4ee1-abe0-454b19bc4cab None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:50.211436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:50.247151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:50.247828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.248112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.248721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.249850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] RBAC: Adding query filter params (role.id=1b25a8853f8d4151abe165c98ff80882, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:50.250169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:50.251798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:50.257602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 519/1049] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:50 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=1b25a8853f8d4151abe165c98ff80882 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:50.272456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6dcaf-a68f-47f0-a13c-b5b9983bc8d3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:50.312753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:50.313636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.313917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.314187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.315598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:50.317068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c895d5-9c70-4194-868f-5a21562d9b1f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:50.323818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 531/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:50.324834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:50.336968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:50.440511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23660-4e96-4e98-83c7-f65a163fac5e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:50.474870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:50.475582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:50.475864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:50.476139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:50.476850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:50.478296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55676-b9d7-4ffd-8820-f57f66e34111 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:50.511372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 520/1051] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:27:50 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:27:52.030022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5ab4-12c4-4cd9-9d72-4c75e98ff022 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.030604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5ab4-12c4-4cd9-9d72-4c75e98ff022 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.030604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5ab4-12c4-4cd9-9d72-4c75e98ff022 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.032137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 532/1052] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:52.037297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803065e6-cec1-420c-a4c6-d0afe09caa78 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.037728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803065e6-cec1-420c-a4c6-d0afe09caa78 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.037808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803065e6-cec1-420c-a4c6-d0afe09caa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.055269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-803065e6-cec1-420c-a4c6-d0afe09caa78 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:52.056483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-803065e6-cec1-420c-a4c6-d0afe09caa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:52.124702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.139495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 521/1053] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:52.156959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5ab4-12c4-4cd9-9d72-4c75e98ff022 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.236559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7d09-0060-4f5c-85da-ebbad6c0abf1 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.236906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7d09-0060-4f5c-85da-ebbad6c0abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.237075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7d09-0060-4f5c-85da-ebbad6c0abf1 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.238635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 522/1054] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:52.243318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.243636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.243880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.261718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:52.262901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:52.269441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5ab4-12c4-4cd9-9d72-4c75e98ff022 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.281285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.307722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.308377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.308658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.308933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.331377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 523/1055] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:52.356692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.386429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:52.388379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:52.457899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6166c1-cbfb-4077-b6c4-82e79d5dcbdb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.483054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.495906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.496739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.497021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.497292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.497866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 533/1056] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:52.503932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.513293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:52.515682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:52.521661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:52.522612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:52.523500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 524/1057] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:52.528980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.614701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1a98-5c32-4c4f-9a34-9e3342f9d45f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.627855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840134-c0b2-48b6-b660-d858032dc8ac None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.648043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.648838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.649116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.649388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.660765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:52.662635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.663013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:52.663299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.663611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.663883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.664817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:52.665112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:52.666514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1966b-794f-4f5b-a11f-cc9f89aa78ef None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:52.676790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 525/1058] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:52.678056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372c76-a28a-4ae1-9be0-a4861d6cf59a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.678341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372c76-a28a-4ae1-9be0-a4861d6cf59a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.678616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372c76-a28a-4ae1-9be0-a4861d6cf59a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.683371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 526/1059] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:52.683371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372c76-a28a-4ae1-9be0-a4861d6cf59a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-bcc21158-bee7-4d78-b47f-cff25a221476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:52.683553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:52.684396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:52.685278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:52.685278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:52.685278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:52.685278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:52.685278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 534/1060] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:52.685814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.686072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.686300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.702729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:52.703942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:52.731788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.758613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.769697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 535/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:52.770491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.791612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372c76-a28a-4ae1-9be0-a4861d6cf59a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.827456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.828383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.828809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.828992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.841725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:52.843298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:52.860872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:52.861851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 527/1062] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:52.863178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.882292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68baa4-8259-48a6-a389-d3a74b2db0b1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.914920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:52.915605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:52.915886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:52.916156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:52.916924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:52.917225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:52.918595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:52.929350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 536/1063] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:52.930114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:52.971834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:52.977260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19499276-7be5-4858-9424-04da3c7b6311 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:52.996647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.028887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.029878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.030042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.030325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.042432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:53.055098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:53.056329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:53.057392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:53.059570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 528/1064] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:53.061196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cff3-fb02-4de2-83e9-df6653154f90 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.066707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.108359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.109742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.109855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.110128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.110871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:53.111172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.112572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.128186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 537/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:53.134110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.189790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee7c5-9fed-46b0-aecb-e60fe68bd02d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.229907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.230571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.230850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.231121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.231882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:53.232184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.233592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.242062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 529/1066] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:53.244408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c9d4-9357-4fad-a4fb-4bc9857a134a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.247835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.257410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.270154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.280074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.281128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.281414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.281685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.290167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.291691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:53.306301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:53.307401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:53.308526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 538/1067] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:53.314718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.349257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11cfa1-d590-4113-8611-fe3fdd333d53 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.384468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.385285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.385568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.385864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] PATH_INFO: `/v3/users/3773499601c94ef3ba985d8ab40db807` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.399130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] RBAC: Authorizing `identity:get_user(user_id=3773499601c94ef3ba985d8ab40db807)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.400622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.402382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 530/1068] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/users/3773499601c94ef3ba985d8ab40db807 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:53.408058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.414510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795cbbe-6021-42ae-9eff-c498cc1fa666 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.449602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.450266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.450542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.450818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.451680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:53.451984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.453418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.470375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 539/1069] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:53.476113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.483567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.504679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c800-c611-40f4-bf8d-16fc8fa7d460 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.505800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.539183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.539862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.540148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.540427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.576478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d831-52ce-409f-83c5-0b4a861c75d5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.605608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.607113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.610960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.611787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.612072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.612345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.622771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.624253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:53.641972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:53.642879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:53.643970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:53.643970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:53.643970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:53.643970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:53.643970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 540/1070] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:53.648686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.685256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.707549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 531/1071] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:27:53.713380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.727673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.746473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0738173-9fdc-487e-824e-114335f4e7b2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.780417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.781077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.781359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.781636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.782358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:53.782663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.784071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.795403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 541/1072] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:53.800802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.815856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e408dc-b898-448d-9711-070092b71d33 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.850209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.851081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.851379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.851668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.852871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.854395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.856156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 532/1073] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:53.862098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.897546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743557-9437-45b2-8cf0-db5db9e71ce2 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.906966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.930547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.931356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.931647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.931938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.938476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:53.939958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:53.953995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:53.954913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:53.955969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:53.959480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 542/1074] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:53.960826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:53.961151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2509b-6502-41cb-8490-10f1018b8509 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:53.963461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:53.996656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:53.997306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:53.997585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:53.997858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:53.998683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=21412edfef3342f5be5c1ef7ef65af71, user.id=3773499601c94ef3ba985d8ab40db807) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:53.998996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:54.000486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:54.006165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 533/1075] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/role_assignments?user.id=3773499601c94ef3ba985d8ab40db807&scope.project.id=21412edfef3342f5be5c1ef7ef65af71&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:54.062433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e945b-ff0f-4d24-960a-6543e5e005e3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:54.100682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:54.101382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:54.101642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:54.101921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:54.102719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:54.103034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:54.104576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9746c-15fe-4863-8719-baad7a3d7eda None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:54.117952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 543/1076] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:54.124205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:54.227676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ca8c8-b816-415a-b934-21616c136e2d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:54.238905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:54.263392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:54.264315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:54.264600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:54.264877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/1b25a8853f8d4151abe165c98ff80882` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:54.267106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=db1031b48c8142508bd94fe89142a9ef, role_id=1b25a8853f8d4151abe165c98ff80882)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:54.268607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4132-d0ba-4ba0-a933-c6034f9db247 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:54.282563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 534/1077] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:54 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/db1031b48c8142508bd94fe89142a9ef/roles/1b25a8853f8d4151abe165c98ff80882 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:27:55.989460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a70fc-b8f0-4a26-be9f-31a20d4521e4 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:55.990050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a70fc-b8f0-4a26-be9f-31a20d4521e4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:55.990050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a70fc-b8f0-4a26-be9f-31a20d4521e4 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:55.991413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 544/1078] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:55.996898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24433f3-1d3e-41b6-9c91-26f697867ead None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:55.997340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24433f3-1d3e-41b6-9c91-26f697867ead None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:55.997454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24433f3-1d3e-41b6-9c91-26f697867ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.015118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e24433f3-1d3e-41b6-9c91-26f697867ead None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:56.016368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e24433f3-1d3e-41b6-9c91-26f697867ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:56.085905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 535/1079] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:56.109348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a70fc-b8f0-4a26-be9f-31a20d4521e4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.170554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.211163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a70fc-b8f0-4a26-be9f-31a20d4521e4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.232122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd105f-920b-459f-b6f3-a57bb33afc86 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.232481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd105f-920b-459f-b6f3-a57bb33afc86 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.232822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd105f-920b-459f-b6f3-a57bb33afc86 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.234260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 536/1080] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:27:56.238976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.239259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.239772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.245238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.246849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.247138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.247454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.255958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:56.257134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:56.257655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:56.265323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:56.266226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:56.267244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 545/1081] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:56.272617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.323863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 537/1082] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:27:56.347821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.368682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865f30-16ef-42d9-99f5-e110c2522a38 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.377990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.392239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.404105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.404769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.405048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.405324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.406067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:56.406371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.407791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.415667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 546/1083] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:56.421683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.450368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424e0e-fcf2-4bd6-954c-be0b49ee6ade None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.484559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.485391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.485681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.485958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.496043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:56.504300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:56.505258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:56.506842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 538/1084] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:27:56.511660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.517994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d800e5-797e-41c1-8738-64eaabc92f5b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.551000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.551901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.552176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.552446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] PATH_INFO: `/v3/users/3773499601c94ef3ba985d8ab40db807` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.553641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] RBAC: Authorizing `identity:get_user(user_id=3773499601c94ef3ba985d8ab40db807)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.555075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.556724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 547/1085] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/users/3773499601c94ef3ba985d8ab40db807 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:56.562306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.601135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.612230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837c28-e107-451f-874f-b017d60d8968 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.615993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.645894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.646561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.646841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.647133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.647919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:56.648229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.649610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.657444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 539/1086] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:56.661799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1d409-b230-4d4d-85e7-2d6b5d716114 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.663043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.696003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.696849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.697133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.697425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.698636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.700098 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.701783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 548/1087] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:56.707664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.763936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ac62-3f8a-48cb-8656-9a5f0071c7b3 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.795885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.796673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.796951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.797216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.803745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82433-7203-4c62-9e2a-a6a059485fe8 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.807362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.808813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.823320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:56.825551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:56.826429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:56.827748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:56.827748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:56.827748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:56.827748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:56.827748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 540/1088] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:56.832398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:56.836054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:56.838345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.839235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.839542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.839813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71/users/3773499601c94ef3ba985d8ab40db807/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.842212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=21412edfef3342f5be5c1ef7ef65af71, user_id=3773499601c94ef3ba985d8ab40db807, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.843524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.856235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 549/1089] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:27:56 2022] PUT /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71/users/3773499601c94ef3ba985d8ab40db807/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:27:56.940187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8e1b-26b7-4b3d-a987-1155f9bb5862 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:56.976267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:56.976953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:56.977239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:56.977504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:56.978254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:56.978564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:56.980224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:56.993386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 541/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:27:56.999257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:57.106557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd011f2-0261-41b2-b1b7-771b5ff641c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:57.141874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:57.142697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:57.142933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:57.143236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:57.151197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:57.152681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:27:57.166949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:57.168015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:57.168974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 550/1091] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 23 13:27:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:57.174050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:57.238327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:57.278072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec965b-e549-4d26-a47b-97b7a899a46f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:57.315220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:57.315931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:57.316208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:57.316490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:57.317311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:57.317616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:57.319052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:57.337857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 542/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 23 13:27:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:57.343981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:57.386554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:57.446586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9968-0528-4764-970a-8e8e21f9c736 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:57.481499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:57.482144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:57.482422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:57.482680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:57.551122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:57.552618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:57.593412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:57.651262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 551/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:57.657091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:57.761506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc25f-1215-427e-bb60-1951ea26eaff None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:57.784496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:57.797098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:57.797898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:57.798180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:57.798453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:57.808620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:57.810090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:27:57.827548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:57.828467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:57.829600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:27:57.829600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:27:57.829600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:27:57.829600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:57.829600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 543/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:57.834633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:57.936478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37676d3-d075-4d46-86ae-58a43b606824 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:57.972555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:57.973208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:57.973485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:57.973757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:57.974471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:57.974772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:57.976168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:57.984524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:57.988190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 552/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:57.993851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:58.098926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c22fa-2d13-4858-b388-b8b76250d6f7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:58.134353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:58.135200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:58.135516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:58.135789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:58.142570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:58.144058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:27:58.157846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:58.158735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:27:58.159654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 544/1096] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:58.165194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:58.263702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85bd92-7540-49f7-96d2-7b13d2b60db4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:58.296046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:58.296693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:58.296968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:58.297241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:58.298016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:58.298320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:58.299787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b5263-042d-47aa-9294-14664196a938 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:58.311398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 553/1097] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:58.317652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:58.355645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:58.421204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18c0f-156a-4f6f-a39a-9e69947e1a7a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:58.456575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:58.457209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:58.457552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:58.458047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:58.459704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] RBAC: Adding query filter params (role.id=1b25a8853f8d4151abe165c98ff80882, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=db1031b48c8142508bd94fe89142a9ef) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:58.460274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:58.461975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a48b-0ca4-4863-a1c8-0548b0023718 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:58.469352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 545/1098] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:58 2022] GET /identity/v3/role_assignments?user.id=db1031b48c8142508bd94fe89142a9ef&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=1b25a8853f8d4151abe165c98ff80882 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:58.838236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d3475-8249-49d7-a732-dd75860d1269 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:58.838522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d3475-8249-49d7-a732-dd75860d1269 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:58.838802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d3475-8249-49d7-a732-dd75860d1269 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:58.840623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 554/1099] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:27:58.846405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:58.846729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:58.847003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:58.864937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:27:58.866171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:58.937017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 546/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:27:58.960751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d3475-8249-49d7-a732-dd75860d1269 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:59.023711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:59.065090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d3475-8249-49d7-a732-dd75860d1269 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:59.100760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:59.101487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:59.101766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:59.102039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:59.115836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:27:59.123585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:27:59.124663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:27:59.125835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 555/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:27:59.130867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:59.161929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:59.236413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e45ce-7b1a-4266-afa7-6bae3656f526 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:59.269615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:59.270281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:59.270562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:59.270835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:59.271615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:27:59.271917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:59.273299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:59.281807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 547/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:59.287785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:59.403056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1856-a403-413e-bdf3-4e40c86457cd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:59.424309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:59.439808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:59.440687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:59.440970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:59.441245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] PATH_INFO: `/v3/users/3773499601c94ef3ba985d8ab40db807` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:59.442484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] RBAC: Authorizing `identity:get_user(user_id=3773499601c94ef3ba985d8ab40db807)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:59.443985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:59.445676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 556/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:27:59 2022] GET /identity/v3/users/3773499601c94ef3ba985d8ab40db807 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:59.451727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:59.553384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:59.564138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b265-1a89-44cc-872c-c15c443ebe24 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:59.597836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:59.598461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:59.598743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:59.599012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:59.666750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:59.668156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:59.758455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:59.769189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 548/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:27:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:27:59.775098 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:59.874034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdcb5-857a-42d2-83d7-43cc13b67427 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:59.914687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:59.915564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:59.915846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:59.916119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:59.917364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:59.918759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1dd2c-83a1-4596-9a17-4979519a522e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:59.920484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 557/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:27:59 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:27:59.927079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:00.034269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d4aea-ac51-492e-87d7-b20d223e74ea None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:00.069059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:00.069696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:00.069976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:00.070245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:00.071067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=21412edfef3342f5be5c1ef7ef65af71, user.id=3773499601c94ef3ba985d8ab40db807) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:00.071384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:00.072870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be438e4-d6b0-426a-a1bd-0f0a5cb65340 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:00.078717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 549/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:27:59 2022] GET /identity/v3/role_assignments?user.id=3773499601c94ef3ba985d8ab40db807&scope.project.id=21412edfef3342f5be5c1ef7ef65af71&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:02.120753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628faf-376d-4ea9-bded-0d0fd739ff7c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:02.121188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628faf-376d-4ea9-bded-0d0fd739ff7c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:02.121277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628faf-376d-4ea9-bded-0d0fd739ff7c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:02.122687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 558/1107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:02.128157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:02.128585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:02.128677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:02.147234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:02.148478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:02.209362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:02.230267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 550/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:02.260383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a628faf-376d-4ea9-bded-0d0fd739ff7c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:02.320983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:02.371368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a628faf-376d-4ea9-bded-0d0fd739ff7c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:02.407198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cff974-e274-4088-9276-981a298f9773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:02.408001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cff974-e274-4088-9276-981a298f9773 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:02.408280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cff974-e274-4088-9276-981a298f9773 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:02.408554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cff974-e274-4088-9276-981a298f9773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:02.409775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cff974-e274-4088-9276-981a298f9773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:02.411210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cff974-e274-4088-9276-981a298f9773 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:02.412849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 559/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:02.421530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:02.535764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbd59c-efe0-4929-81f6-9e43aae49fa9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:02.570927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:02.571639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:02.571920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:02.572197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:02.572938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:02.574386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53768c4-e97c-4968-a27b-ed26f192fd34 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:02.599648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 551/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:28:02 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:04.649406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbddbb-c47c-40d8-865b-c6ff1530b6e5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:04.650462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbddbb-c47c-40d8-865b-c6ff1530b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:04.650462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbddbb-c47c-40d8-865b-c6ff1530b6e5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:04.652623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 560/1111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:04.661789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:04.662506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:04.662683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:04.687754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:04.688950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:04.726451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:04.763407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 552/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:04.787370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbddbb-c47c-40d8-865b-c6ff1530b6e5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:04.902964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbddbb-c47c-40d8-865b-c6ff1530b6e5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:04.926415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:04.939615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:04.940470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:04.940754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:04.941037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] PATH_INFO: `/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:04.942624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] RBAC: Authorizing `identity:get_role(role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:04.944050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:04.945441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 561/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:04 2022] GET /identity/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:04.951520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:05.058172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2031db0-670a-4d1d-a28d-cd24b92b4111 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:05.099932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:05.100810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:05.101087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:05.101360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] PATH_INFO: `/v3/users/bb8f611f354d4891ba8941958b4e0f2d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:05.114981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] RBAC: Authorizing `identity:get_user(user_id=bb8f611f354d4891ba8941958b4e0f2d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:05.116566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:05.118235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 553/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:04 2022] GET /identity/v3/users/bb8f611f354d4891ba8941958b4e0f2d => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:05.124163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:05.223376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e38c-31f1-45ad-b9bf-be2fb7a284a1 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:05.257876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:05.258511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:05.258787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:05.259057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:05.319472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:05.331912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:05.333380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:05.449453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 562/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:28:05.455836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:05.487768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:05.575469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321710-3c81-4dd9-9b9c-2ed821111e2f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:05.612177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:05.613051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:05.613331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:05.613596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:05.614823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:05.616338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df849-4316-4605-89d0-e11c86b55774 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:05.618165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 554/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:05 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:05.625151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:05.722504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:05.734235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390302-01ef-4697-870e-1f6a020e585c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:05.772021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:05.772602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:05.772877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:05.773151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:05.773967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=21412edfef3342f5be5c1ef7ef65af71, user.id=bb8f611f354d4891ba8941958b4e0f2d) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:05.774275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:05.775733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1419b6c-9c8b-4d37-a31a-da7cd400dc17 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:05.781282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 563/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:05 2022] GET /identity/v3/role_assignments?user.id=bb8f611f354d4891ba8941958b4e0f2d&scope.project.id=21412edfef3342f5be5c1ef7ef65af71&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:07.754644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3978-b599-4fb9-8bbd-579dfca3c923 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:07.755690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3978-b599-4fb9-8bbd-579dfca3c923 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:07.755690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3978-b599-4fb9-8bbd-579dfca3c923 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:07.757767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 555/1118] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:07.763249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:07.763696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:07.763813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:07.782287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:07.783495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:07.851246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 564/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:07.874086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3978-b599-4fb9-8bbd-579dfca3c923 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:07.984043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:07.992159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3978-b599-4fb9-8bbd-579dfca3c923 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.028937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.029728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.030011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.030278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] PATH_INFO: `/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.031920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] RBAC: Authorizing `identity:get_role(role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.033319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.034697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 556/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:07 2022] GET /identity/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:08.040777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:08.129508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:08.145296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057125c2-f5a1-487b-8a8e-21c2de9d566a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.180342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.181217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.181553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.181834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] PATH_INFO: `/v3/users/bb8f611f354d4891ba8941958b4e0f2d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.183154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] RBAC: Authorizing `identity:get_user(user_id=bb8f611f354d4891ba8941958b4e0f2d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.184644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.186288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 565/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:08 2022] GET /identity/v3/users/bb8f611f354d4891ba8941958b4e0f2d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:08.195288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:08.299220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f172f2-3a21-44a9-9739-b1ed79ce5ce7 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.334307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.335199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.335509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.335782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.337090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.338610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508a65b-0ad7-402b-bb3a-b870b63af3c4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.340703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 557/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:08 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:08.349948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:08.459658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc6f4-7930-4d54-a853-48784175d476 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.495162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.496084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.496362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.496636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71/users/bb8f611f354d4891ba8941958b4e0f2d/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.499246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] RBAC: Authorizing `identity:create_grant(project_id=21412edfef3342f5be5c1ef7ef65af71, user_id=bb8f611f354d4891ba8941958b4e0f2d, role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.500744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1cae-8f22-4d7c-bb7d-e12797957906 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.517205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 566/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:28:08 2022] PUT /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71/users/bb8f611f354d4891ba8941958b4e0f2d/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:28:10.477346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b800-9b2d-4bb4-8dda-f9490ded05f1 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:10.478229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b800-9b2d-4bb4-8dda-f9490ded05f1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:10.478229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b800-9b2d-4bb4-8dda-f9490ded05f1 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:10.480429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 558/1124] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:10.488330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:10.488775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:10.488880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:10.508024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:10.509197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:10.519358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:10.586548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 567/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:28:10.612021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77b800-9b2d-4bb4-8dda-f9490ded05f1 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:10.651511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:10.725493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77b800-9b2d-4bb4-8dda-f9490ded05f1 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:10.763112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:10.763950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:10.764234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:10.764508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] PATH_INFO: `/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:10.766133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] RBAC: Authorizing `identity:get_role(role_id=c92df3ac580e42cbb7797ca0e2c314bb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:10.767553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:10.768932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 559/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:10 2022] GET /identity/v3/roles/c92df3ac580e42cbb7797ca0e2c314bb => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:10.774921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:10.877895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608a55a-976a-4856-b192-4bd2ee2168ae None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:10.914046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:10.914918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:10.915194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:10.915494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] PATH_INFO: `/v3/users/bb8f611f354d4891ba8941958b4e0f2d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:10.916761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] RBAC: Authorizing `identity:get_user(user_id=bb8f611f354d4891ba8941958b4e0f2d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:10.918233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:10.919877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 568/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:10 2022] GET /identity/v3/users/bb8f611f354d4891ba8941958b4e0f2d => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:10.926320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:11.033385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:11.036492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd316-f942-4ece-a958-ceba55b0705f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:11.075066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:11.075740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:11.076021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:11.076296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:11.145183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:11.146652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:11.250136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:11.256229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 560/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:11.265692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:11.284964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:11.372733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555dbb-1eea-447d-9917-24eb219bdebf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:11.408081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:11.408937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:11.409217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:11.409488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] PATH_INFO: `/v3/projects/21412edfef3342f5be5c1ef7ef65af71` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:11.410712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] RBAC: Authorizing `identity:get_project(project_id=21412edfef3342f5be5c1ef7ef65af71)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:11.412182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367c561-d600-4b2c-a58a-f665dad629b8 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:11.413870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 569/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:11 2022] GET /identity/v3/projects/21412edfef3342f5be5c1ef7ef65af71 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:11.420612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:11.522032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1107a1a-0546-4def-b56c-cf02be0bf872 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:11.559354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:11.559959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:11.560243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:11.560520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:11.561478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] RBAC: Adding query filter params (role.id=c92df3ac580e42cbb7797ca0e2c314bb, scope.project.id=21412edfef3342f5be5c1ef7ef65af71, user.id=bb8f611f354d4891ba8941958b4e0f2d) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:11.561793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:11.563249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550f68c-b942-49ab-ab4d-cc2283586165 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:11.569316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 561/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:11 2022] GET /identity/v3/role_assignments?user.id=bb8f611f354d4891ba8941958b4e0f2d&scope.project.id=21412edfef3342f5be5c1ef7ef65af71&role.id=c92df3ac580e42cbb7797ca0e2c314bb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:13.605689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34fb9-40b1-4028-bfb4-9b3d983dd1ef None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:13.606269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34fb9-40b1-4028-bfb4-9b3d983dd1ef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:13.606269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34fb9-40b1-4028-bfb4-9b3d983dd1ef None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:13.607653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 570/1131] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:13.614178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:13.614872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:13.615023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:13.635667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:13.636857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:13.702179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:13.716410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 562/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:13.740636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c34fb9-40b1-4028-bfb4-9b3d983dd1ef None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:13.833302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:13.859927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c34fb9-40b1-4028-bfb4-9b3d983dd1ef None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:13.894896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:13.895702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:13.895987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:13.896261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:13.897564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:13.899015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380de442-9187-456f-a17d-d72e3e5f374a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:13.900685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 571/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:13.909744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:14.024715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4302-371a-4252-aaab-664b6c9863d7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:14.061121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:14.061775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:14.062062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:14.062341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:14.063048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:14.064537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085d1be-03cc-4079-ae61-159e4f90b572 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:14.092504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 563/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:28:13 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:16.137559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa841dc-381f-4b77-833a-fb905e6f200c None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:16.138033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa841dc-381f-4b77-833a-fb905e6f200c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:16.138130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa841dc-381f-4b77-833a-fb905e6f200c None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:16.139622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 572/1135] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:16.145348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:16.145780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:16.145877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:16.165161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:16.166472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:16.210909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:16.236702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 564/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:16.263171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa841dc-381f-4b77-833a-fb905e6f200c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:16.367836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa841dc-381f-4b77-833a-fb905e6f200c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:16.402661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:16.403450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:16.403731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:16.404002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:16.405281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:16.406729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f288e37-fe93-4d24-b135-bc57bf95d90d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:16.408356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 573/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:16.414662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:16.530628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066849ec-b6ab-40e4-8d4a-e695d51aaf5b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:16.566092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:16.566753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:16.567033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:16.567310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:16.568059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:16.569508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15343-00a2-450a-a5b4-0ae54c3b5ae7 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:16.593823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 565/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:28:16 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:18.654876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac1b7-b3ff-4002-9ac3-5eef58208229 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:18.655488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac1b7-b3ff-4002-9ac3-5eef58208229 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:18.655488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac1b7-b3ff-4002-9ac3-5eef58208229 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:18.656854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 574/1139] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:18.663204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:18.663988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:18.664134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:18.688377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:18.689544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:18.717278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:18.763497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 566/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:18.786761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac1b7-b3ff-4002-9ac3-5eef58208229 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:18.805275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:18.895714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac1b7-b3ff-4002-9ac3-5eef58208229 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:18.931243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:18.931982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:18.932259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:18.932528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:18.943395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:18.950957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:18.952124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:18.953268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 575/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:18.958614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:19.064709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0170c8-5041-41b0-a661-a012b410b1af None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:19.103944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:19.104626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:19.104905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:19.105178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:19.105937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:19.106244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:19.107665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:19.116218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 567/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:19.122711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:19.206898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:19.233120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488c478-e8fd-4725-b5fe-f6f3568812fb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:19.267870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:19.268724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:19.269001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:19.269272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] PATH_INFO: `/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:19.283579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb0ebcf13ed42648cc2629c8ac08e82)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:19.285014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:19.286632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 576/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:19 2022] GET /identity/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:19.293293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:19.329806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:19.409313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55536-3f8c-4981-ab4c-092adf9f2d48 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:19.450743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:19.451382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:19.451695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:19.451967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:19.525101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:19.526509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:19.553620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:19.630393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 568/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:19.636692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:19.746861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a225-0257-4cc2-a8c1-ad8ec9653098 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:19.787546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:19.788336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:19.788608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:19.788886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] PATH_INFO: `/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:19.790109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] RBAC: Authorizing `identity:get_project(project_id=60a52d7f5d2f43d2b4416ad15afbfc0d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:19.791613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c495b-a8f5-4c54-93a5-1fd838714f0e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:19.793301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 577/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:19 2022] GET /identity/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:19.800987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:19.910881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaea2-01e1-4bdb-bca0-f23092c34893 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:19.935299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:19.947090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:19.947780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:19.948061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:19.948337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:19.949168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=60a52d7f5d2f43d2b4416ad15afbfc0d, user.id=ceb0ebcf13ed42648cc2629c8ac08e82) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:19.949475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:19.950923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402720f3-01fe-4d9b-9175-2661f286a001 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:19.956448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 569/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:19 2022] GET /identity/v3/role_assignments?user.id=ceb0ebcf13ed42648cc2629c8ac08e82&scope.project.id=60a52d7f5d2f43d2b4416ad15afbfc0d&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:21.950792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1835c-0c1a-40c8-b530-0a5a9fa0b648 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:21.951679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1835c-0c1a-40c8-b530-0a5a9fa0b648 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:21.951679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1835c-0c1a-40c8-b530-0a5a9fa0b648 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:21.953908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 578/1147] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:21.962975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:21.963425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:21.963578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:21.987159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:21.988393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:22.072159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 570/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:22.098126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1835c-0c1a-40c8-b530-0a5a9fa0b648 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:22.101433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:22.206155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1835c-0c1a-40c8-b530-0a5a9fa0b648 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:22.243924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:22.244704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:22.244985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:22.245256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:22.256070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:22.263765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:22.264837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:22.265839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:22.267532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 579/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:28:22.271220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:22.386223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd2e5-68a5-438c-8473-cdf41375c3d6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:22.406260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:22.429442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:22.430120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:22.430406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:22.430680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:22.431467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:22.431780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:22.433315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:22.441719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 571/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:22.447912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:22.514661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:22.553349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29b9c-ff46-4672-9b51-f12faff7f019 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:22.587826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:22.588747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:22.589023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:22.589295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] PATH_INFO: `/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:22.590908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb0ebcf13ed42648cc2629c8ac08e82)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:22.592372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:22.593977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 580/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:22 2022] GET /identity/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:22.600594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:22.712026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e99f6-9d4b-4021-9d77-58ac18a9cb71 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:22.751427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:22.752303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:22.752579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:22.752854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] PATH_INFO: `/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:22.754144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=60a52d7f5d2f43d2b4416ad15afbfc0d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:22.755629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd1949-a741-4257-8aef-7096ecebc9f8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:22.757349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 572/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:22 2022] GET /identity/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:22.764291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:22.877481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f00-784b-40ac-9dcb-9dfaf4dc6631 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:22.905522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:22.912062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:22.912940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:22.913214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:22.913485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] PATH_INFO: `/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d/users/ceb0ebcf13ed42648cc2629c8ac08e82/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:22.915708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a52d7f5d2f43d2b4416ad15afbfc0d, user_id=ceb0ebcf13ed42648cc2629c8ac08e82, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:22.917217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853cdb-e2ce-423e-98e9-18572bd32bc2 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:22.931984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 581/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:28:22 2022] PUT /identity/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d/users/ceb0ebcf13ed42648cc2629c8ac08e82/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:28:24.950199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca91b3-8e4d-4f20-9cce-0a095edfeec2 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:24.950756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca91b3-8e4d-4f20-9cce-0a095edfeec2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:24.950756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca91b3-8e4d-4f20-9cce-0a095edfeec2 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:24.952185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 573/1154] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:24.958554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:24.959250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:24.959398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:24.985086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:24.986261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:25.056192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 582/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:25.086744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca91b3-8e4d-4f20-9cce-0a095edfeec2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:25.142439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:25.198568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca91b3-8e4d-4f20-9cce-0a095edfeec2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:25.233935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:25.234671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:25.234953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:25.235236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:25.246631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:25.254361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:25.255462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:28:25.256481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 574/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:25.262387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:25.374444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43f9e-7440-4197-a6e9-0022aaf40375 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:25.396224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:25.414150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:25.414827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:25.415107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:25.415405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:25.416157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:25.416463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:25.417854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:25.425954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 583/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:25.434431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:25.540965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704c25-d0c6-4913-a1fa-f1d24efc3452 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:25.550133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:25.576904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:25.577779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:25.578063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:25.578343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] PATH_INFO: `/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:25.579618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb0ebcf13ed42648cc2629c8ac08e82)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:25.581072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:25.582700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 575/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:25 2022] GET /identity/v3/users/ceb0ebcf13ed42648cc2629c8ac08e82 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:25.589260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:25.708873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aad6d-1ba6-4cf7-8e3b-fc3bbc65a80b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:25.750165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:25.751101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:25.751629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:25.751997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:25.805369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:25.832310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:25.833756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:25.933234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 584/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:25.942705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:26.047427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cecdc-9893-42e5-a01c-6c07f38d94e2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:26.081662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:26.082449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:26.082729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:26.082992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] PATH_INFO: `/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:26.084238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] RBAC: Authorizing `identity:get_project(project_id=60a52d7f5d2f43d2b4416ad15afbfc0d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:26.085665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c7cf8-f739-4673-93b1-724f4b80dda9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:26.087311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 576/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:25 2022] GET /identity/v3/projects/60a52d7f5d2f43d2b4416ad15afbfc0d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:26.094017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:26.175253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:26.194729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccce6e0-0852-4650-89fc-90a1bbce22c6 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:26.231952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:26.232598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:26.232878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:26.233146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:26.233967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=60a52d7f5d2f43d2b4416ad15afbfc0d, user.id=ceb0ebcf13ed42648cc2629c8ac08e82) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:26.234279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:26.235736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fbe43-51cc-4b31-a2f3-058a7777e3eb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:26.241699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 585/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:26 2022] GET /identity/v3/role_assignments?user.id=ceb0ebcf13ed42648cc2629c8ac08e82&scope.project.id=60a52d7f5d2f43d2b4416ad15afbfc0d&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:28.251374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9a0a-0e5e-4710-86a6-9ddd5cc687b7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:28.251936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9a0a-0e5e-4710-86a6-9ddd5cc687b7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:28.251936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9a0a-0e5e-4710-86a6-9ddd5cc687b7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:28.253309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 577/1162] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:28.259622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:28.260377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:28.260638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:28.288947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:28.290854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:28.360675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 586/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:28:28.386894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9a0a-0e5e-4710-86a6-9ddd5cc687b7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:28.437419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:28.502277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9a0a-0e5e-4710-86a6-9ddd5cc687b7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:28.546758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:28.547393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:28.547701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:28.547967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:28.619509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:28.620959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:28.668223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:28.729623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 578/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:28.736250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:28.817114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:28.841011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8c8b-83ff-43db-972b-16eeb40d9842 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:28.880451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:28.881191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:28.881473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:28.881746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:28.889271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:28.890737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-25bde856-c761-4b54-9313-607d4f3b2c4d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:28.904754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:28.905899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:28.906848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 587/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:28:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:28.912068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:29.015486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed8fb-c2b3-4e0e-b944-ba991010b74f None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:29.049917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:29.050562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:29.050845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:29.051119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:29.051875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:29.052180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:29.053561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e73e9e-9d34-46e5-b593-a7ec21a9242b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:29.060806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 579/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 23 13:28:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:31.022327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338217b-edcf-4194-aed8-76d930a79498 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:31.023164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338217b-edcf-4194-aed8-76d930a79498 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:31.023325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338217b-edcf-4194-aed8-76d930a79498 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:31.025392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 588/1167] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:31.031822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c99f-4336-4c6c-bce3-f97ba027bae5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:31.032494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c99f-4336-4c6c-bce3-f97ba027bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:31.032713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c99f-4336-4c6c-bce3-f97ba027bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:31.053762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5219c99f-4336-4c6c-bce3-f97ba027bae5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:31.054956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5219c99f-4336-4c6c-bce3-f97ba027bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:31.056887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:31.133148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 580/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:31.156590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338217b-edcf-4194-aed8-76d930a79498 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:31.266126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338217b-edcf-4194-aed8-76d930a79498 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:31.301483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:31.302053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:31.302329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:31.302593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:31.303328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:31.304707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5bcf-40d3-4bfe-8423-206431f14a3d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:31.308248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:31.324847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 589/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Jun 23 13:28:31 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:33.369418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00ebb-15da-4aa0-8b62-59673429aae6 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:33.369939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00ebb-15da-4aa0-8b62-59673429aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:33.369939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00ebb-15da-4aa0-8b62-59673429aae6 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:33.371316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 581/1170] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:33.376822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:33.377235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:33.377361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:33.395526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:33.396710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:33.466499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 590/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:33.490320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00ebb-15da-4aa0-8b62-59673429aae6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:33.617138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00ebb-15da-4aa0-8b62-59673429aae6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:33.651705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:33.652570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:33.652854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:33.653125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] PATH_INFO: `/v3/domains/5d26dfcc18234a09ab398221776bd658` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:33.660036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:33.664830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=5d26dfcc18234a09ab398221776bd658)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:33.666650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad07c-68cc-4f11-b39e-dbc684f9dcbd None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:33.668325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 582/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 23 13:28:33 2022] GET /identity/v3/domains/5d26dfcc18234a09ab398221776bd658 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:33.677798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:33.783211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dd50f-d618-400f-b156-f6d21a901316 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:33.808893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:33.818388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:33.819035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:33.819312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:33.819608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:33.820309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:33.821735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fe67-3758-48a4-8fd5-b0729ca5162d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:33.849992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 591/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:28:33 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:35.900469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302152-0a23-4894-bb47-4e608f1c3649 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:35.901143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302152-0a23-4894-bb47-4e608f1c3649 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:35.901143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302152-0a23-4894-bb47-4e608f1c3649 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:35.902462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 583/1174] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:35.908851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:35.909586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:35.909744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:35.935671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:35.936845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:36.008897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 592/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:36.033352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a302152-0a23-4894-bb47-4e608f1c3649 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:36.144612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a302152-0a23-4894-bb47-4e608f1c3649 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:36.180003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:36.180810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:36.181117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:36.181393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] PATH_INFO: `/v3/domains/5d26dfcc18234a09ab398221776bd658` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:36.182819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=5d26dfcc18234a09ab398221776bd658)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:36.184296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02193f2-774b-4808-950a-04eae3817b5f None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:36.185915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 584/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 23 13:28:36 2022] GET /identity/v3/domains/5d26dfcc18234a09ab398221776bd658 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:36.191824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:36.292869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f028101-1b53-4650-a45c-ef1f7ee325df None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:36.302356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:36.336324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:36.336985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:36.337271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:36.337553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:36.338253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:36.340045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5beb87-2391-45ab-87a8-f583203c7e0c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:36.360793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 593/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:28:36 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:38.393922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6195-b934-46bb-ae11-7f986c930296 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:38.394774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6195-b934-46bb-ae11-7f986c930296 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:38.394774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6195-b934-46bb-ae11-7f986c930296 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:38.397069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 585/1178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:38.404229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:38.404661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:38.404778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:38.423206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:38.424427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:38.496189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 594/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:28:38.520316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6195-b934-46bb-ae11-7f986c930296 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:38.600533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:38.651274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6195-b934-46bb-ae11-7f986c930296 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:38.689927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:38.690717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:38.690998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:38.691272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:38.702874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:38.710573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:38.711745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:28:38.712662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 586/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:38.718999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:38.816485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:38.823765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4210a0-421b-45e5-9c89-6ea0bc3fb096 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:38.859815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:38.860465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:38.860741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:38.861018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:38.861748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:38.862046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:38.863447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:38.872060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 595/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:38.878112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:38.982323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a0b5-7e6d-4bf1-af6b-b34cc0a45d24 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:39.008096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:39.019445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:39.020318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:39.020596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:39.020865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] PATH_INFO: `/v3/users/1162cfb875f94940ac064b50fe69c944` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:39.034307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] RBAC: Authorizing `identity:get_user(user_id=1162cfb875f94940ac064b50fe69c944)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:39.035786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:39.037405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 587/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:38 2022] GET /identity/v3/users/1162cfb875f94940ac064b50fe69c944 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:39.043518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:39.147957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097c649-c75c-46fe-b1a5-bcef606f606d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:39.182021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:39.182657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:39.182937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:39.183212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:39.209512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:39.255660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:39.257041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:39.368224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 596/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:39.374632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:39.496900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7012-95f0-4beb-b1a1-0bb2ad24a144 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:39.536794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:39.537594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:39.537871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:39.538139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] PATH_INFO: `/v3/projects/d300dfc74c964986b00bcaa98b3aed96` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:39.539449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] RBAC: Authorizing `identity:get_project(project_id=d300dfc74c964986b00bcaa98b3aed96)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:39.540904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733283a-a410-4919-baf2-c476a858a281 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:39.542712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 588/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:39 2022] GET /identity/v3/projects/d300dfc74c964986b00bcaa98b3aed96 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:39.552591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:39.609629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:39.658667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772cd9a-9424-4d00-9289-4527937077bb None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:39.694474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:39.695109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:39.695374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:39.695681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:39.696488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=d300dfc74c964986b00bcaa98b3aed96, user.id=1162cfb875f94940ac064b50fe69c944) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:39.696794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:39.698252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8097f-5e71-40aa-8902-a3ef65be0e3e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:39.704318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 597/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:39 2022] GET /identity/v3/role_assignments?user.id=1162cfb875f94940ac064b50fe69c944&scope.project.id=d300dfc74c964986b00bcaa98b3aed96&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:41.676455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd479b5-e5e1-4c4d-ac74-33b0bad233ed None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:41.677337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd479b5-e5e1-4c4d-ac74-33b0bad233ed None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:41.677337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd479b5-e5e1-4c4d-ac74-33b0bad233ed None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:41.679603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 589/1186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:41.685161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:41.685591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:41.685684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:41.704300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:41.705485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:41.777304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 598/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:41.805855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd479b5-e5e1-4c4d-ac74-33b0bad233ed None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:41.868435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:41.927424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd479b5-e5e1-4c4d-ac74-33b0bad233ed None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:41.961708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:41.962502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:41.962778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:41.963095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:41.975368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:41.983223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:41.984297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:28:41.985206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 590/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:41.991070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:42.044204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:42.098150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90c95-adac-43ec-af78-dc64be229758 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:42.134249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:42.134990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:42.135447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:42.135715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:42.136463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:42.136774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:42.138155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:42.146241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 599/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:42.152466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:42.261305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781b2a-3944-4327-b402-117175b811c6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:42.279875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:42.305810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:42.306707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:42.306981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:42.307257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] PATH_INFO: `/v3/users/1162cfb875f94940ac064b50fe69c944` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:42.308544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=1162cfb875f94940ac064b50fe69c944)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:42.309995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:42.311654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 591/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:42 2022] GET /identity/v3/users/1162cfb875f94940ac064b50fe69c944 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:28:42.317439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:42.420451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435f606-61e4-4273-a3a2-03ee7557b4b7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:42.433213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:42.456508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:42.457368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:42.457647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:42.457917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] PATH_INFO: `/v3/projects/d300dfc74c964986b00bcaa98b3aed96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:42.459139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] RBAC: Authorizing `identity:get_project(project_id=d300dfc74c964986b00bcaa98b3aed96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:42.460610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f810da-c4fc-4f5f-8983-36480fcc0b78 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:42.462292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 600/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:42 2022] GET /identity/v3/projects/d300dfc74c964986b00bcaa98b3aed96 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:42.468801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:42.572715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0ce0-12fc-468f-8041-e69816533ae6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:42.607545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:42.608431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:42.608707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:42.608981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] PATH_INFO: `/v3/projects/d300dfc74c964986b00bcaa98b3aed96/users/1162cfb875f94940ac064b50fe69c944/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:42.611195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] RBAC: Authorizing `identity:create_grant(project_id=d300dfc74c964986b00bcaa98b3aed96, user_id=1162cfb875f94940ac064b50fe69c944, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:42.612659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b97f5-47b2-416b-a085-cc50cfb47834 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:42.629514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 592/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:28:42 2022] PUT /identity/v3/projects/d300dfc74c964986b00bcaa98b3aed96/users/1162cfb875f94940ac064b50fe69c944/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:28:44.611062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c602-47ac-4ac0-aa77-8534eae68ca3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:44.611682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c602-47ac-4ac0-aa77-8534eae68ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:44.611682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c602-47ac-4ac0-aa77-8534eae68ca3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:44.613051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 601/1193] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:28:44.619372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:44.619802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:44.619920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:44.643830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:44.645026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:44.686563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:44.727350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 593/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:28:44.751273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9c602-47ac-4ac0-aa77-8534eae68ca3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:44.859271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9c602-47ac-4ac0-aa77-8534eae68ca3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:44.893285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:44.894132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:44.894496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:44.894802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:44.905747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:28:44.913295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:28:44.914414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:28:44.915369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 602/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:28:44.921682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:45.029876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14154-3ee1-43f0-925b-8619af92ff41 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:45.064706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:45.065357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:45.065631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:45.065900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:45.066649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:45.066937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:45.068350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:45.076495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 594/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:45.082567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:45.129551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:45.189350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db6506-10b9-41a9-b0b9-668839465699 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:45.224577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:45.225574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:45.225859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:45.226136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] PATH_INFO: `/v3/users/1162cfb875f94940ac064b50fe69c944` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:45.227380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] RBAC: Authorizing `identity:get_user(user_id=1162cfb875f94940ac064b50fe69c944)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:45.228905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:45.230666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 603/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 23 13:28:45 2022] GET /identity/v3/users/1162cfb875f94940ac064b50fe69c944 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:45.237528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:45.279098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:45.346246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f18b91-19a1-4d41-aef6-ef774c80a6d2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:45.381019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:45.381676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:45.381954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:45.382223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:45.450471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:45.451950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:45.482946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:45.553555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 595/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:28:45.560035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:45.664506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d51e-fa70-48e7-9f97-2d14e5a35c5d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:45.674139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:45.701825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:45.702637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:45.702919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:45.703183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] PATH_INFO: `/v3/projects/d300dfc74c964986b00bcaa98b3aed96` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:45.704468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] RBAC: Authorizing `identity:get_project(project_id=d300dfc74c964986b00bcaa98b3aed96)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:45.705952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd686a-1b2d-4303-bc63-34bfce07bf57 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:45.707725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 604/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 23 13:28:45 2022] GET /identity/v3/projects/d300dfc74c964986b00bcaa98b3aed96 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:45.714613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:45.817382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f754-5cce-4a7c-9e35-1fdf511f7874 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:45.847686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:45.854078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:45.854778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:45.855055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:45.855348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:45.856215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=d300dfc74c964986b00bcaa98b3aed96, user.id=1162cfb875f94940ac064b50fe69c944) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:45.856545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:45.858015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a3846-3db5-4881-b992-35ac16c47ce5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:45.864089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 596/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:28:45 2022] GET /identity/v3/role_assignments?user.id=1162cfb875f94940ac064b50fe69c944&scope.project.id=d300dfc74c964986b00bcaa98b3aed96&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:55.696185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=12 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:55.861253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:41.085753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1f1b-5679-44f9-9e2e-eafc4773ac58 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:41.086336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1f1b-5679-44f9-9e2e-eafc4773ac58 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:41.086336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1f1b-5679-44f9-9e2e-eafc4773ac58 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:41.087742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 605/1201] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:29:41.093499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:41.093940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:41.094025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:41.113179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:29:41.114481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:41.194769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 597/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:29:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:29:41.221560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a1f1b-5679-44f9-9e2e-eafc4773ac58 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:41.353274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a1f1b-5679-44f9-9e2e-eafc4773ac58 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:41.393068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:41.393925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:41.394200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:41.394499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:41.407797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:41.409304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:41.431198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:41.432347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:41.433345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:41.433345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:41.433345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:41.433345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:41.433345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 606/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:41.439121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:41.582562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da40f7-5078-4cd0-bea7-5cc6575aee57 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:41.619621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:41.627265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:41.627991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:41.628268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:41.628546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:41.629297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:41.629600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:41.631009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92693967-0f58-4a01-8077-27c8a24be95d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:41.643534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 598/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:41.650581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:41.729920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:41.795136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a45a-7e08-49db-afc4-439ba60a91ff None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:41.846955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:41.847768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:41.848049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:41.848357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:41.849185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:41.851283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e928e-7d96-4b05-aa9f-c6fcfcdbfba4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:41.887025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 607/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 23 13:29:41 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:29:44.362939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f05d4-8e76-4a2d-b57d-fa7ecdb674a9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:44.363465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f05d4-8e76-4a2d-b57d-fa7ecdb674a9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:44.363465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f05d4-8e76-4a2d-b57d-fa7ecdb674a9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:44.364840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 599/1206] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:29:44.371414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b522-303a-4d86-8478-6f805995b04f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:44.371904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b522-303a-4d86-8478-6f805995b04f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:44.371995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b522-303a-4d86-8478-6f805995b04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:44.391341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f600b522-303a-4d86-8478-6f805995b04f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:29:44.392583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f600b522-303a-4d86-8478-6f805995b04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:44.478776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 608/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:29:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:29:44.502398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f05d4-8e76-4a2d-b57d-fa7ecdb674a9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:44.637573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f05d4-8e76-4a2d-b57d-fa7ecdb674a9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:44.680323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:44.681152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:44.681472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:44.681809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:44.694227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:29:44.702402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:44.703879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:44.704725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 600/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:29:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:44.710627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b522-303a-4d86-8478-6f805995b04f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:44.754256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:44.824443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b522-303a-4d86-8478-6f805995b04f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:44.866855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:44.867474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:44.867754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:44.868026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:44.868780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:44.869089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:44.870477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:44.879988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 609/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:44.885742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:44.946414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:45.008381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2f45e-40a7-4179-b95b-3aaa9ad35273 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:45.048995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:45.049830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:45.050077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:45.050351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:45.062866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:45.064464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:45.086711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:45.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:45.089109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:45.089109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:45.089109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:45.089109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:45.089109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 601/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:45.095544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:45.215181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:45.218439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067764bd-25b6-4715-9e49-19d9375e3e55 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:45.263266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:45.264062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:45.264414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:45.264792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:45.265521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:45.265877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:45.267436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:45.281144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 610/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:45.286177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:45.402659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01e44-8c8a-4a6e-a2b8-7e9e4ee5a717 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:45.404292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:45.439284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:45.440117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:45.440417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:45.440710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:45.448891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:45.450362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:29:45.467684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:45.468700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:45.469664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 602/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:45.474552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:45.585467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ca2e-4f52-4acf-b9a7-b521fce9926f None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:45.623877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:45.624612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:45.624800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:45.625086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:45.626162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:45.626283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:45.627809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:45.646793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 611/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:29:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:29:45.652895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:45.784311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d411403-02c5-44af-80c0-82e7d4a7547e None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:45.823268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:45.824647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:45.824647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:45.824832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:45.865119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:45.920761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:45.922367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.038185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 603/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:29:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:29:46.044167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:46.067017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:46.156160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6172-bf0d-4fb4-9970-c7b5faf1400e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:46.192825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:46.193693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:46.193971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:46.194241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:46.205555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:46.207020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:46.226630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:46.227627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:46.228641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:46.228641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:46.228641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:46.228641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:46.228641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 612/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:46.233612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:46.307703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:46.352515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a379-b9a3-4081-b0be-74ee5a934a58 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:46.392368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:46.393193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:46.393568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:46.393935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:46.394773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:46.395162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:46.397363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.411462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 604/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:46.417170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:46.508941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:46.543601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8655d7-2159-4fac-adfc-a385816ba2c4 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:46.583710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:46.584499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:46.584782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:46.585059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:46.592899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:46.594338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:29:46.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:46.609244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:46.610214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:46.611741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 613/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:29:46.615612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:46.734171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0863e4c-da03-42f1-a7b4-364eb4edfe8a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:46.761746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:46.775422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:46.776164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:46.776579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:46.776909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:46.777788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:46.778147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:46.779677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258dced-c476-4ab1-b026-aa6ace34bd85 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.797837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 605/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:46.798832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:46.918452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b474-4af4-4f40-8b69-19acc016a524 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:46.947794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:46.955230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:46.955964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:46.956303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:46.956645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:46.957587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=76f162edbf8449589dcb9cf2bbd8cf1a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:46.957926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:46.959499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0553-f6b6-4a26-ab88-3399ab4e9d94 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:46.966259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 614/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:29:46 2022] GET /identity/v3/role_assignments?user.id=76f162edbf8449589dcb9cf2bbd8cf1a&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:48.981579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a1b0-49e7-421d-957e-9d2c53d0285f None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:48.982124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a1b0-49e7-421d-957e-9d2c53d0285f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:48.982124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a1b0-49e7-421d-957e-9d2c53d0285f None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:48.983998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 606/1220] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:29:48.990895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:48.991408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:48.991666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.012695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:29:49.014055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:49.087386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 615/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:29:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:29:49.110205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9a1b0-49e7-421d-957e-9d2c53d0285f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:49.220628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9a1b0-49e7-421d-957e-9d2c53d0285f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:49.256087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:49.256936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:49.257213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:49.257483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.268524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:29:49.276369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:49.277387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:49.278233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 607/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:49.284905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:49.393957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c96f-efa7-4076-aede-e4c00a722762 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:49.417932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:49.429732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:49.430481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:49.430749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:49.431112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.431903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] RBAC: Adding query filter params (name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:49.432195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:49.433817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:49.442718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 616/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:49.448929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:49.495618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:49.558128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172733-f248-4c47-9e84-87a3a2a11f72 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:49.596062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:49.596968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:49.597314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:49.597677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.608924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:49.610386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:49.628378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:49.629611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:49.630635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:49.630635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:49.630635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:49.630635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:49.630635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 608/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:49.636070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:49.744900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5bdaa-26e9-4c40-838f-017ef05d353d None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:49.779176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:49.779867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:49.780148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:49.780418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.781144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:49.781445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:49.782850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:49.795528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 617/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:49.801324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:49.903025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:49.910967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1aec-82bc-425f-8417-666014701dc9 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:49.947511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:49.948323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:49.948610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:49.948881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:49.956664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:49.958313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:29:49.973736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:49.974943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:49.976001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 609/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:49.981097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.033094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:50.090711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0455524-b1f0-46f4-b0ac-d91760f9bd29 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:50.127638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:50.128308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:50.128593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:50.128895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:50.129868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:50.130177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:50.131779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:50.150595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 618/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:29:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:50.156571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.270369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9ab03-fc75-4526-8f0e-bbbfb022132b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:50.310501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:50.311414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:50.311699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:50.311974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:50.324343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:50.325973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:50.347636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:50.348771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:50.349764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:50.349764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:50.349764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:50.349764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:50.349764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 610/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:50.354967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.464938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9427-8284-46e0-8067-cd207984641c None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:50.467640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:50.509536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:50.510234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:50.510567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:50.510842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:50.511704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:50.512031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:50.513595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:50.526799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 619/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:29:50.532820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.543795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:50.647983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a18d1-0310-44f5-9506-e0ef3324e7f6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:50.686371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:50.688509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:50.688825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:50.689221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:50.698405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:50.700196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:29:50.718278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:50.719368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:50.720482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:50.727043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 611/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:50.727164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.843810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737150-0a2a-4e5b-88c6-7138bc6da8a7 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:50.883660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:50.884419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:50.884742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:50.885101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:50.886172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:50.886477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:50.888119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cea7b-eaec-4ff3-8d2c-2a613c08476b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:50.900530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 620/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:50.906678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:50.974402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:51.014096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e3bb-8bbb-4cad-9f22-8d0d88a6e9c6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:51.050340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:51.051404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:51.051644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:51.051936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/76f162edbf8449589dcb9cf2bbd8cf1a/roles/0e5688f295c345df887e8c4f54376831` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:51.068249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=76f162edbf8449589dcb9cf2bbd8cf1a, role_id=0e5688f295c345df887e8c4f54376831)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:51.069779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5b2c3-9820-48a9-8443-0b3d52299448 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:51.084982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 612/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:29:50 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/76f162edbf8449589dcb9cf2bbd8cf1a/roles/0e5688f295c345df887e8c4f54376831 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:29:53.271088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8014e-f69f-49f8-9419-4e643760c6ef None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:53.271694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8014e-f69f-49f8-9419-4e643760c6ef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:53.271694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8014e-f69f-49f8-9419-4e643760c6ef None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:53.273110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 621/1233] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:29:53.278893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:53.279397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:53.279495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:53.295912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:29:53.297081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:53.367179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 613/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:29:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:29:53.392112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8014e-f69f-49f8-9419-4e643760c6ef None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:53.418966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:53.499893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8014e-f69f-49f8-9419-4e643760c6ef None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:53.534904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:53.535861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:53.536143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:53.536418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:53.547289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:29:53.555809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:53.557263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:53.558371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 622/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 23 13:29:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:29:53.563611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:53.617348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:53.678380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535286f-28fd-4c25-a4e6-6ce73380232f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:53.720087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:53.721012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:53.721560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:53.721940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:53.723007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:53.723502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:53.725242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:53.737301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 614/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 23 13:29:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:53.743565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:53.840251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:53.860728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500db9a-ab25-46f3-bf75-16f97079e08a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:53.907705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:53.908506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:53.908786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:53.909057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:53.919977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:53.921475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:53.939807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:53.940794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:53.941819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:53.941819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:53.941819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:53.941819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:53.941819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 623/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:53.948172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:54.059958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608fa25-ae36-44cc-ae55-4fa443f02c93 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:54.071846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:54.101994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:54.102718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:54.103021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:54.103269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:54.104049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:54.104362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:54.105780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:54.120426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 615/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:29:54.126878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:54.238276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477f54-677b-4d87-863f-6b521e2943b9 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:54.278409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:54.279236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:54.279548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:54.279824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:54.283458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:54.288738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:54.290379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:29:54.308041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:54.309375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:54.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 624/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:29:54.315476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:54.428735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fc221-2029-4c23-b79d-bab5ffe74fee None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:54.463855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:54.464562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:54.464850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:54.465151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:54.465996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:54.466304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:54.467851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:54.492566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 616/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:29:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:54.498593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:54.612135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bf36-ffb3-49c8-aec0-3ff5160304c5 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:54.653302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:54.654303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:54.654708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:54.655181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:54.724583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:54.732483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:54.734314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:54.847480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 625/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:29:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:29:54.854005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:54.890211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:54.974725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ef40-f004-4751-8ab0-66689fecc675 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:55.014422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:55.015440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:55.015743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:55.016029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:55.028072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:55.029732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:55.048866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:55.050064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:55.051325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:55.051325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:55.051325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:55.051325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:55.051325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 617/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:29:55.056626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:55.173221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:55.181187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfba64-6c0e-4d1a-9243-4cdb89b9a957 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:55.224029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:55.224706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:55.225017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:55.225375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:55.226134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:55.226514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:55.227937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:55.241813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 626/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:55.248449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:55.339386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:55.368119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d9cbf-cc65-450c-a92f-4a7b276c6f09 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:55.403702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:55.404768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:55.405169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:55.405498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:55.414098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:55.415881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:29:55.432615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:55.433807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:55.434867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 618/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:55.440317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:55.553145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a945ea-e93e-4b6a-936d-133fa2b55947 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:55.591159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:55.591842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:55.592209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:55.592483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:55.593264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:55.593569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:55.594995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878ff91-1e85-4ef5-876c-fb57955ddd20 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:55.607230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 627/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:55.613685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:55.729094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6b6ac-0c56-4148-8f3f-e6d4c466c5f2 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:55.766898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:55.767713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:55.768111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:55.768424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:55.769385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] RBAC: Adding query filter params (role.id=0e5688f295c345df887e8c4f54376831, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=76f162edbf8449589dcb9cf2bbd8cf1a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:55.769683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:55.771144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d8a1-9872-492a-9241-ea20d1ad82a1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:55.777451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 619/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:29:55 2022] GET /identity/v3/role_assignments?user.id=76f162edbf8449589dcb9cf2bbd8cf1a&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=0e5688f295c345df887e8c4f54376831 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:58.012259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e185a-211d-4711-942c-93734df6dbc3 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.013056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e185a-211d-4711-942c-93734df6dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.013056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e185a-211d-4711-942c-93734df6dbc3 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.014557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 628/1247] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:29:58.020351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.020829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.021003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.026486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:58.040453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:29:58.041676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:58.122434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 620/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:29:58.152835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e185a-211d-4711-942c-93734df6dbc3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:58.175925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:58.276884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e185a-211d-4711-942c-93734df6dbc3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:58.317609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:58.318594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.318877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.319154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.330354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:29:58.338418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:58.339529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:58.340389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 629/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:58.346198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:58.450511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3968-5a18-44c8-a37e-1c31fa2a52e9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:58.484222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:58.490035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:58.490768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.491070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.491374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.492195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:58.492483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:58.493982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:58.503346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 621/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:29:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:58.509441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:58.597330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:58.623068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024fa7-0fb1-46b9-97da-e48cecf12853 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:58.661708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:58.663575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.663906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.664171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.678066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:58.679888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:58.701647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:58.702640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:58.703631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:58.703631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:58.703631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:58.703631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:58.703631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 630/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:58.709448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:58.830035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6225f8-de8a-4d8e-bad0-bab2dc95d952 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:58.871724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:58.872341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:58.872599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:58.872886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:58.873946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:58.874303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:58.875923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:58.895228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 622/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:58.896834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:59.012104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0a0d-84c1-4bb0-a7a1-a9a090141d49 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:59.042287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:59.051509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:59.052349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:59.052624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:59.052893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:59.062489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:59.064151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:29:59.081874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:59.083164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:29:59.084405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 631/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:29:59.089593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:59.151109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:59.196854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cd03-142c-4cf2-a6c1-2a6708787be4 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:59.232243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:59.233040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:59.233354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:59.233631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:59.234619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:59.234975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:59.236625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:59.255321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 623/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:29:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:59.261690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:59.366404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecbdd-83fa-495a-a6a4-de91b9675f7a None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:59.405068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:59.405732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:59.406008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:59.406307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:59.463605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:59.476192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:59.477661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:59.583742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 632/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:29:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:29:59.591008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:59.705775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118de8-1974-4a17-8636-ec72c99dd0cf None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:59.721321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:59.746220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:59.747143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:59.747454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:59.747725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:59.759625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:59.761322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:29:59.780285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:29:59.783636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:29:59.784603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:29:59.784603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:29:59.784603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:29:59.784603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:29:59.784603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 624/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:29:59.789241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:59.890911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:59.907080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480b6b-2127-4db7-8992-f98ecf2e44fd None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:59.946533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:59.947458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:59.947782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:59.948059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:59.948902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:29:59.949251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:59.950718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:59.962464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 633/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:29:59.968652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:00.081175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f42ab-940f-44c3-b6cf-a88a38e4a5f0 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:00.121216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:00.122022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:00.122301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:00.122572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:00.130216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:00.131713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:30:00.146744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:00.147899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:00.148857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 625/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:00.154764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:00.269834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f1f8-892e-467f-a39a-c863dc7e3542 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:00.306420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:00.307102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:00.307482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:00.307819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:00.308836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:00.309143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:00.310575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2273f-870e-45c9-aa42-b80914a12c4b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:00.324602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 634/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:00.331032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:00.357824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:00.445042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22112c-a618-4388-9451-43654f428e1a None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:00.480106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:00.480739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:00.481024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:00.481293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:00.482127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=76f162edbf8449589dcb9cf2bbd8cf1a) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:00.482446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:00.483984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36daa1-56a6-4865-83bd-4b4804acd12b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:00.491719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 626/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:30:00 2022] GET /identity/v3/role_assignments?user.id=76f162edbf8449589dcb9cf2bbd8cf1a&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:02.493709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f934a-34cd-41e0-bf8c-660671db160b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:02.494581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f934a-34cd-41e0-bf8c-660671db160b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:02.494581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f934a-34cd-41e0-bf8c-660671db160b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:02.496820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 635/1261] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:02.502281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:02.502696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:02.502806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:02.520982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:02.522164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:02.594472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 627/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:02.618815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f934a-34cd-41e0-bf8c-660671db160b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:02.640416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:02.747984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f934a-34cd-41e0-bf8c-660671db160b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:02.784201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:02.785021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:02.785298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:02.785566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:02.796549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:30:02.804128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:02.805210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:02.808153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 636/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:02.813627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:02.835350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:02.934112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e4a9-555f-4d78-b0ec-ee2de8be45ad None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:02.973464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:02.974131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:02.974420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:02.974695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:02.975478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:02.975788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:02.977175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:02.985378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 628/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:02.991648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:03.065856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:03.100235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66ea0-04a5-4b87-93a5-b1bcf71caeaf None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:03.143457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:03.144245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:03.144520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:03.144791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:03.156539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:03.157981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:30:03.176033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:03.177040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:03.178131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:30:03.178131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:30:03.178131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:03.178131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:03.178131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 637/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:03.183539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:03.275691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:03.305254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a85e3-59e8-494d-bf7c-100a6aa0a455 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:03.346927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:03.347933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:03.348435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:03.348861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:03.349596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:03.350104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:03.351999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:03.364271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 629/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:03.372476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:03.489742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98650b-570f-47b3-9fba-e4e45e387c36 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:03.509907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:03.534218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:03.535019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:03.535294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:03.535599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:03.543798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:03.545364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:30:03.560789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:03.561887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:03.563316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 638/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:03.571324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:03.700523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea46dc-6d7d-49cf-b680-bff5e2021b41 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:03.744879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:03.745545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:03.745827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:03.746099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:03.746941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:03.747284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:03.748852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:03.757629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:03.766581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 630/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:30:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:03.775157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:03.905852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee093-1477-48a3-bcc9-1bb209009131 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:03.944465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:03.945258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:03.945651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:03.945916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:03.957555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:03.958999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:30:03.977536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:03.978568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:03.986113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:30:03.986113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:30:03.986113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:03.986113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:03.986113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 639/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:03.986674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:04.115024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd397a-749a-4339-8bc5-de38b9ddd51c None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:04.153379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:04.154035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:04.154343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:04.154613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:04.155366 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:04.155674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:04.157052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:04.168425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 631/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:04.175005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:04.213351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:04.288810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d7fb-7b47-4836-925d-0af61bb19f83 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:04.324311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:04.325155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:04.325442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:04.325716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:04.333302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:04.334785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:30:04.349938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:04.350946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:04.352023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:04.355523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 640/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:04.357310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:04.423092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:04.472508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365d49-d9a3-44d9-be37-584156cb0fe5 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:04.507351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:04.508008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:04.508287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:04.508555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:04.509336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:04.509638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:04.511103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe8b70-c3e5-431c-a293-0eee2d934b46 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:04.523090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 632/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:04.531740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:04.623575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:04.633060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b8fe1-1d0a-4ff1-867f-4a0d176a0eb3 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:04.668387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:04.669266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:04.669548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:04.669843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] PATH_INFO: `/v3/projects/dafa1feb40ac418d998266bb876614a3/users/76f162edbf8449589dcb9cf2bbd8cf1a/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:04.672111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafa1feb40ac418d998266bb876614a3, user_id=76f162edbf8449589dcb9cf2bbd8cf1a, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:04.673555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c94c-8ef0-4da3-92c3-14204085e219 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:04.689988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 641/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 23 13:30:04 2022] PUT /identity/v3/projects/dafa1feb40ac418d998266bb876614a3/users/76f162edbf8449589dcb9cf2bbd8cf1a/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:30:06.654871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2913-a831-4658-a1f4-1e06294b884c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:06.655765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2913-a831-4658-a1f4-1e06294b884c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:06.655765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2913-a831-4658-a1f4-1e06294b884c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:06.657985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 633/1274] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:06.664313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:06.665079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:06.665232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:06.690368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:06.691624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:06.771547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 642/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:06.794668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c2913-a831-4658-a1f4-1e06294b884c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:06.902199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c2913-a831-4658-a1f4-1e06294b884c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:06.919711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:06.937799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:06.938606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:06.938884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:06.939158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:06.950854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:30:06.958610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:06.959720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:06.960708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 634/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 23 13:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:06.966348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.055770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:07.076557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21152fa-d1c4-4728-a3cd-42df0476e7c9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:07.112861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:07.113533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:07.113816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:07.114089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:07.114835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:07.115136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:07.116546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:07.124729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 643/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 23 13:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:07.130619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.239701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe816d-b124-4e53-a2a3-f35d1afda542 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:07.274326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:07.275075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:07.275392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:07.275678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:07.286353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:07.287828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:30:07.307662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:07.308798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:07.309836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:30:07.309836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:30:07.309836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:07.309836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:07.309836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 635/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:07.315790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.433574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdae40-bf89-4122-9281-d9737c27046e None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:07.474079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:07.474730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:07.475005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:07.475251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:07.476028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:07.476331 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:07.477709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:07.489289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 644/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:07.495206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.527005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:07.605403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479609-157d-4437-b36b-bf9da533c106 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:07.640420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:07.641203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:07.641481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:07.641748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:07.649478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:07.650926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:30:07.665553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:07.667056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:07.668259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 636/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:07.672779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.676950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:07.784337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492401b-7876-4b5c-aae9-308fd448f627 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:07.820408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:07.821069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:07.821348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:07.821619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:07.822444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:07.822754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:07.824208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:07.841398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 645/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 23 13:30:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:07.847952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:07.955086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:07.966231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c4c1-510f-4f24-8b6c-345499c03a75 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:08.006401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:08.007478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:08.007761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:08.008035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:08.110229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:08.111732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:08.201001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:08.213510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 637/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 23 13:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:30:08.222977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:08.296990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:08.339625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143789c-f6ca-46b6-a7a0-960d47d6d137 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:08.391940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:08.392771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:08.393056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:08.393336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:08.404416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:08.405998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:30:08.424942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:08.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:08.427023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:30:08.427023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:30:08.427023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:30:08.427023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:08.427513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 646/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:08.432750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:08.542377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbd9b-4714-40df-acfb-d1416840fce8 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:08.577098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:08.577765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:08.578047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:08.578321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:08.579033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:08.579381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:08.580736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:08.592296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 638/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 23 13:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:08.601420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:08.708334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e3680-5068-451c-b2fd-fbae86a44206 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:08.722688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:08.750322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:08.751107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:08.751419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:08.751695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:08.758653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:08.760128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:30:08.774232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:08.775276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: ERROR keystone.server.flask.application Jun 23 13:30:08.776431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 647/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 23 13:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:08.782141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:08.844364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:08.908651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089dcc6-d8b9-41cb-b069-4a9651fcb2a6 None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:08.943911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:08.944569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:08.944854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:08.945129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:08.945915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:08.946232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:08.947703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77f1c-aa9c-45cc-8f13-e997a0823f7e None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:08.959897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 639/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 23 13:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:08.966499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:09.071849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed76b-0f2b-45fe-9cf5-7428942c3e07 None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:09.109129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:09.109343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:09.109624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:09.109898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:09.110731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] RBAC: Adding query filter params (role.id=77bb21c1be16493181bb82f412685ca2, scope.project.id=dafa1feb40ac418d998266bb876614a3, user.id=76f162edbf8449589dcb9cf2bbd8cf1a) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:09.111039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:09.112517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76261b78-037a-401f-bc8e-c4e619d89335 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:09.118595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 648/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 23 13:30:08 2022] GET /identity/v3/role_assignments?user.id=76f162edbf8449589dcb9cf2bbd8cf1a&scope.project.id=dafa1feb40ac418d998266bb876614a3&role.id=77bb21c1be16493181bb82f412685ca2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:11.180475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389db0-d047-4af8-83dc-1a11f067df50 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:11.181247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389db0-d047-4af8-83dc-1a11f067df50 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:11.181489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389db0-d047-4af8-83dc-1a11f067df50 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:11.183608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 640/1288] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:11.190596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:11.191024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:11.191193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:11.218820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:11.220038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:11.251378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:11.292490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 649/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:11.322022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389db0-d047-4af8-83dc-1a11f067df50 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:11.437714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389db0-d047-4af8-83dc-1a11f067df50 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:11.448260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:11.473369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:11.474187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:11.474470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:11.474745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:11.475435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:11.476837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:11.491595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:11.493553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:11.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 641/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:30:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:11.500675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:11.603866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf98ed-beeb-4ced-a0ad-6adf02513991 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:11.640972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:11.641619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:11.641895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:11.642163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:11.642870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:11.643169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:11.644560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd9218-ad01-4462-830b-d831f68d0992 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:11.649762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 650/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 23 13:30:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:11.655605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:11.759544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4372-e319-44e8-9254-000f1a05ec7b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:11.797418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:11.798334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:11.798722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:11.799077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] PATH_INFO: `/v3/services` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:11.800234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:11.800674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:11.802798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f886-09c3-43f6-b052-d88ee84bb879 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:11.810537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 642/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 23 13:30:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:13.796538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1d11-0e5a-474c-8f78-dbdbc2378823 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:13.797135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1d11-0e5a-474c-8f78-dbdbc2378823 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:13.797135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1d11-0e5a-474c-8f78-dbdbc2378823 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:13.798454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 651/1293] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:13.805359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72ab0-bbc2-4ba9-8c81-bb99e9660a19 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:13.806069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72ab0-bbc2-4ba9-8c81-bb99e9660a19 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:13.806261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72ab0-bbc2-4ba9-8c81-bb99e9660a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:13.830447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1af72ab0-bbc2-4ba9-8c81-bb99e9660a19 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:13.831686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1af72ab0-bbc2-4ba9-8c81-bb99e9660a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:13.872505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:13.917916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 643/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:13.945676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1d11-0e5a-474c-8f78-dbdbc2378823 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:13.978942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:14.053307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1d11-0e5a-474c-8f78-dbdbc2378823 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:14.092759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:14.093424 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:14.093704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:14.093976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:14.094700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:14.096110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488687b-a3eb-449c-b78b-99d5c75891b5 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:14.111567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 652/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 23 13:30:13 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:30:16.121413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326852b-7a23-4330-9764-d0cda0784a81 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.121925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326852b-7a23-4330-9764-d0cda0784a81 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.121925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326852b-7a23-4330-9764-d0cda0784a81 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.123462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 644/1296] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:16.129761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.130510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.130646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.153656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:16.154919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:16.245300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 653/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:16.269325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326852b-7a23-4330-9764-d0cda0784a81 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:16.395909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326852b-7a23-4330-9764-d0cda0784a81 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:16.434067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:16.434876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.435231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.435534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.436191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:16.437580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:16.449899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:16.451034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:16.452077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 645/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:30:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:16.460921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:16.482502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:16.566210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5db9f2-61a3-4f72-9d9e-c03ddd13e99b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:16.602751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:16.603446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.603727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.604007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.604717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:16.605024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:16.606422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:16.611909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 654/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 23 13:30:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:16.618047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:16.650742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:16.738726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017c7f-8c47-482d-9e18-9e1cf3e02f5d None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:16.773104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:16.773754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.774037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.774314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.775106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] RBAC: Adding query filter params (interface=public, service_id=ac5f41d789474f4f9f46f9f2b26f5ab7, region_id=RegionOne) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:16.775453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:16.776830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ed22-6cd5-4ae0-881b-e1a862240990 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:16.781985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 646/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 23 13:30:16 2022] GET /identity/v3/endpoints?service_id=ac5f41d789474f4f9f46f9f2b26f5ab7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:16.787941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:16.879555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:16.899173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa256-bb0a-4f2d-b15c-7dd341ca1e7b None admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:16.933368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:16.933963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:16.934242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:16.934513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:16.935218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:16.936640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89639207-cef8-46ee-adf3-bbedc6474059 None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:16.943668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 655/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 23 13:30:16 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:30:18.922298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f704-8476-45b6-a693-383d8c4e738c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:18.923133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f704-8476-45b6-a693-383d8c4e738c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:18.923266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f704-8476-45b6-a693-383d8c4e738c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:18.925409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 647/1302] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:30:18.931612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:18.932352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:18.932523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:18.956983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:30:18.958171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:19.028743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 656/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:30:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:30:19.057922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f704-8476-45b6-a693-383d8c4e738c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:19.165725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:19.173455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f704-8476-45b6-a693-383d8c4e738c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:19.208473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:19.209276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:19.209563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:19.209838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:19.210494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:19.211923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:30:19.224686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:30:19.225818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application with Lock( Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: ERROR keystone.server.flask.application Jun 23 13:30:19.226696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 648/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 23 13:30:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:30:19.232911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:19.316876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:19.350430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e66d7-e092-435c-8e9f-0cff75e78ef2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:19.385903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:19.386552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:19.386830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:19.387097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] PATH_INFO: `/v3/services` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:19.387875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:30:19.388173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:19.389538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a8e1-0b62-48c0-bed4-6a2a183bba1a None admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:19.394732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 657/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 23 13:30:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:30:19.403267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:19.511491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8a89-3ff7-4df1-953d-d4e63da52d0b None admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:19.546339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:19.546987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:19.547273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:19.547584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:19.548328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:19.549719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0527-2efe-4284-b65d-d6161c946fd1 None admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:19.571656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 649/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 23 13:30:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:30:29.392120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=30 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:29.567172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:23.243172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4acf9-ec7d-49ca-9e92-95c2bb3ef3a7 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:23.243699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4acf9-ec7d-49ca-9e92-95c2bb3ef3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:23.243789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4acf9-ec7d-49ca-9e92-95c2bb3ef3a7 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:23.245136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 658/1307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:23.256352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac93c6-b507-4b16-900d-cfd27b77a444 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:23.258666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac93c6-b507-4b16-900d-cfd27b77a444 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:23.259149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac93c6-b507-4b16-900d-cfd27b77a444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:23.412607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-aaac93c6-b507-4b16-900d-cfd27b77a444 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:23.413837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aaac93c6-b507-4b16-900d-cfd27b77a444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:23.527716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 650/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:23.577018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:23.577307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:23.577752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:23.579176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 659/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 23 13:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:23.586403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529d55-f4b2-497e-8ee1-954066c63574 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:23.586747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529d55-f4b2-497e-8ee1-954066c63574 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:23.586969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529d55-f4b2-497e-8ee1-954066c63574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:23.664919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-75529d55-f4b2-497e-8ee1-954066c63574 None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:23.666189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-75529d55-f4b2-497e-8ee1-954066c63574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:23.687909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:23.748155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 651/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 23 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:23.756933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:23.758742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:23.883369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff75cc-6f01-4dc2-92f4-b3cf48ad31b2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:23.973494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:23.974181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:23.974459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:23.974729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:23.976415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:24.032484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:24.097455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:24.099084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad9eb9-ee2b-4453-b59c-29214c96e9f6 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:24.123696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 660/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:31:26.415007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:26.415681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:26.415825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:26.417343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 652/1312] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:26.423356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d7ac-4dd9-471e-8d62-801bb48afbde None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:26.423865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d7ac-4dd9-471e-8d62-801bb48afbde None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:26.423945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d7ac-4dd9-471e-8d62-801bb48afbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:26.515847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8e82d7ac-4dd9-471e-8d62-801bb48afbde None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:26.517461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8e82d7ac-4dd9-471e-8d62-801bb48afbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:26.626159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 661/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:26.664152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:26.666036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:26.780986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145f82f-005c-420a-af8e-a3b7ae06bdd3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:26.869572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:26.871751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:26.872672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:26.873134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:26.873566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:26.875633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:26.996813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:26.998379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d0cba-1037-4b01-b547-4401122cabb1 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:27.017593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 653/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:29.324167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:29.325038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:29.325038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:29.326509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 662/1315] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:29.331874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eace7-ef3b-46ef-9fb3-b762ad02029e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:29.332291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eace7-ef3b-46ef-9fb3-b762ad02029e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:29.332430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eace7-ef3b-46ef-9fb3-b762ad02029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:29.415581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fa6eace7-ef3b-46ef-9fb3-b762ad02029e None None] MFA Rules not processed for user `bab5072763ec4572ae0e1127303e56ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:29.416809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fa6eace7-ef3b-46ef-9fb3-b762ad02029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:29.480958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:29.540896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 654/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:29.582865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:29.584471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:29.595713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:29.695103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176796ce-86cf-48cf-9961-f6c977fbe5e5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:29.777573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:29.778298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:29.778581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:29.778851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:29.780537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:29.843962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:29.894508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:29.896013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cac3d-78ec-49cd-93c5-b3a61c208c5e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:29.914270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 663/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:32.427554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:32.428374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:32.428374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:32.430548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 655/1318] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:32.437053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad9a5-eb7b-40b4-b482-7dea9a00f308 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:32.437524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad9a5-eb7b-40b4-b482-7dea9a00f308 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:32.437655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad9a5-eb7b-40b4-b482-7dea9a00f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:32.519317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-72fad9a5-eb7b-40b4-b482-7dea9a00f308 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:32.520555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72fad9a5-eb7b-40b4-b482-7dea9a00f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:32.625143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 664/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:32.667598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:32.670073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:32.784238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c19aad-8b34-4b4b-8bc4-4bcac256c464 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:32.870251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:32.871167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:32.871656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:32.872183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:32.873920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:32.881738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:32.988506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:32.989964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaec47-1653-4458-82e0-243b5d0e56f1 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:33.008628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 656/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:35.676994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:35.677549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:35.677549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:35.678956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 665/1321] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:35.684368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdae3-43d7-4619-92cb-d4f46dfbab55 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:35.684777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdae3-43d7-4619-92cb-d4f46dfbab55 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:35.684906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdae3-43d7-4619-92cb-d4f46dfbab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:35.750664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6ebfdae3-43d7-4619-92cb-d4f46dfbab55 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:35.751896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ebfdae3-43d7-4619-92cb-d4f46dfbab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:35.810034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:35.853034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 657/1322] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:35.890561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:35.892189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:35.912877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:36.002380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6af7a-7d5a-4ba7-8142-3f28aaeef464 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:36.081439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:36.082086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:36.082366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:36.082638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:36.084320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:36.158896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:36.196984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:36.198419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaf83-3b00-42bd-a264-5ca68f716742 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:36.217926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 666/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:38.309221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013697-aa14-4fe7-a803-5e670d5b3a40 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:38.309763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013697-aa14-4fe7-a803-5e670d5b3a40 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:38.309763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013697-aa14-4fe7-a803-5e670d5b3a40 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:38.311257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 658/1324] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:38.316631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04a881-fe6e-4192-b118-eeaacb3e44a7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:38.317066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04a881-fe6e-4192-b118-eeaacb3e44a7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:38.317162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04a881-fe6e-4192-b118-eeaacb3e44a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:38.383894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9c04a881-fe6e-4192-b118-eeaacb3e44a7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:38.385146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9c04a881-fe6e-4192-b118-eeaacb3e44a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:38.484802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 667/1325] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:38.534822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:38.535082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:38.535373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:38.536800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 659/1326] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 23 13:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:38.542846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099866a-5101-48cd-83b2-94a882c824e0 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:38.543172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099866a-5101-48cd-83b2-94a882c824e0 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:38.543576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099866a-5101-48cd-83b2-94a882c824e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:38.574671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:38.621039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e099866a-5101-48cd-83b2-94a882c824e0 None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:38.622256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e099866a-5101-48cd-83b2-94a882c824e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:38.704081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 668/1327] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 23 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:38.713368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:38.714904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:38.830917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919bd7-ee8e-4b37-883a-2386faef0f71 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:38.904291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:38.904936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:38.905215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:38.905488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:38.907122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:38.923475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:39.017255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:39.018704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b97bd-d1d8-46d3-bee3-69ae5c42cb1d service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:39.036859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 660/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:41.311032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:41.311640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:41.311640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:41.313139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 669/1329] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:41.318183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0832988-4fe6-48e5-8343-d520f437a7ad None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:41.318628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0832988-4fe6-48e5-8343-d520f437a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:41.318872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0832988-4fe6-48e5-8343-d520f437a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:41.405321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0832988-4fe6-48e5-8343-d520f437a7ad None None] MFA Rules not processed for user `bab5072763ec4572ae0e1127303e56ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:41.406554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0832988-4fe6-48e5-8343-d520f437a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:41.477212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:41.513538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 661/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:41.554174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:41.555747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:41.662946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea185f4-85e3-4e9d-a4a2-a1741ecd599b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:41.683357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:41.738656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:41.739394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:41.739722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:41.740123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:41.742777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:41.869274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:41.870722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f0c9c-c7e7-48cb-a0d3-26ba8fae3e2e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:41.890819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 670/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:31:44.321215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:44.322038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:44.322156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:44.324597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 662/1332] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:44.330024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359ba5-cc0c-4bb0-a500-4ae2bebaa435 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:44.330451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359ba5-cc0c-4bb0-a500-4ae2bebaa435 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:44.330699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359ba5-cc0c-4bb0-a500-4ae2bebaa435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:44.394567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:44.397706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4c359ba5-cc0c-4bb0-a500-4ae2bebaa435 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:44.399393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4c359ba5-cc0c-4bb0-a500-4ae2bebaa435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:44.509019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 671/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:44.546262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:44.548800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:44.667296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341983c-7f09-48d0-9f9a-74528ebe0b39 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:44.766384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:44.767498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:44.767994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:44.768282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:44.770654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:44.801697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:44.890362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:44.891880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042e2a3-bdf2-4379-a048-03919a0460fb service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:44.910323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 663/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:46.939222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:46.939815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:46.939815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:46.941178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 672/1335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:46.949723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d444-7d23-453c-ba8f-8aed4f797d6b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:46.950409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d444-7d23-453c-ba8f-8aed4f797d6b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:46.950597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d444-7d23-453c-ba8f-8aed4f797d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:47.023790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0309d444-7d23-453c-ba8f-8aed4f797d6b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:47.025032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0309d444-7d23-453c-ba8f-8aed4f797d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:47.108294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:47.133314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 664/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:47.176476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:47.178943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:47.293832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e62f0b-5ff7-48bd-8938-c527b0184749 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:47.322705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:47.369784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:47.370355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:47.370635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:47.370905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:47.372594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:47.486974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:47.488458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62022cdb-1aaa-427e-85da-f9c0d94c4795 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:47.514802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 673/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:49.961980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:49.962541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:49.962541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:49.963954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 665/1338] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:49.970316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6500e4-e62f-406e-a9c0-ee05386dd3a4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:49.971079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6500e4-e62f-406e-a9c0-ee05386dd3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:49.971228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6500e4-e62f-406e-a9c0-ee05386dd3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:50.046556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0a6500e4-e62f-406e-a9c0-ee05386dd3a4 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:50.047803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0a6500e4-e62f-406e-a9c0-ee05386dd3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:50.056208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:50.149450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 674/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:50.185778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:50.188231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:50.305897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be230-191a-4cde-9df0-b57afc8294f9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:50.385008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:50.385659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:50.385939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:50.386213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:50.387953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:50.423369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:50.510450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:50.512021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c2382-af54-4c57-b9ad-638f615d2d9c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:50.531172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 666/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:54.581363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:54.581886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:54.581886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:54.583207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 675/1341] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:54.589106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d7c8-a0a2-49d8-b23b-8aa49d99e706 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:54.589599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d7c8-a0a2-49d8-b23b-8aa49d99e706 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:54.589787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d7c8-a0a2-49d8-b23b-8aa49d99e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:54.665273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4f67d7c8-a0a2-49d8-b23b-8aa49d99e706 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:54.666490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4f67d7c8-a0a2-49d8-b23b-8aa49d99e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:54.762706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:54.776749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 667/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:54.815048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:54.817488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:54.926428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2f54-8849-4836-b9ac-3fe3fb1bf5b8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:54.930521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:54.931168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:54.931477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:54.931752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:54.940921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:54.942376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b9725-4118-44be-9970-098b66979587 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:54.951796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 676/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:57.546982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1c2a-356e-4fbf-b250-d7c17644a414 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:57.547558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1c2a-356e-4fbf-b250-d7c17644a414 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:57.547883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1c2a-356e-4fbf-b250-d7c17644a414 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:57.549279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 668/1344] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:31:57.554816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6316-065b-4a43-9be4-6ce28cea438a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:57.555586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6316-065b-4a43-9be4-6ce28cea438a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:57.555586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6316-065b-4a43-9be4-6ce28cea438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:57.583706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bbfa6316-065b-4a43-9be4-6ce28cea438a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:31:57.584913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bbfa6316-065b-4a43-9be4-6ce28cea438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:57.615722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:57.669293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 677/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:31:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:31:57.707669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b1c2a-356e-4fbf-b250-d7c17644a414 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:57.720140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b1c2a-356e-4fbf-b250-d7c17644a414 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:57.724024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:57.724689 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:57.724993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:57.725268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:57.735424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:57.737063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df9d3-15a4-4a35-b9ba-a7871b1e1937 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:57.747596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 669/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:01.765243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a1f6-01ad-450d-8260-b881ddc5506d None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:01.765630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a1f6-01ad-450d-8260-b881ddc5506d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:01.765796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a1f6-01ad-450d-8260-b881ddc5506d None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:01.767319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 678/1347] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:01.772600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ade8-9b2c-4587-bf54-5d254a901dfc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:01.773058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ade8-9b2c-4587-bf54-5d254a901dfc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:01.773139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ade8-9b2c-4587-bf54-5d254a901dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:01.792110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f580ade8-9b2c-4587-bf54-5d254a901dfc None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:01.793247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f580ade8-9b2c-4587-bf54-5d254a901dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:01.801398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 670/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:01.838529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290a1f6-01ad-450d-8260-b881ddc5506d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:01.852381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290a1f6-01ad-450d-8260-b881ddc5506d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:01.857495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:01.858212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:01.858495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:01.858767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:01.868876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:01.870409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cada-cc43-4b52-b208-e90adc271af9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:01.880306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 679/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:06.831326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe10-6ff6-4e6c-b38f-4f5f024ac9e8 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:06.831826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe10-6ff6-4e6c-b38f-4f5f024ac9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:06.831908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe10-6ff6-4e6c-b38f-4f5f024ac9e8 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:06.833554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 671/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:06.839018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824350-9164-4604-bb46-803d0cf2a8c2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:06.839783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824350-9164-4604-bb46-803d0cf2a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:06.840215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824350-9164-4604-bb46-803d0cf2a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:06.917160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cf824350-9164-4604-bb46-803d0cf2a8c2 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:06.918840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cf824350-9164-4604-bb46-803d0cf2a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:07.001881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 680/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:32:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:10.954569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e43b-03af-47d2-a29f-6745244d9ac3 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:10.955730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e43b-03af-47d2-a29f-6745244d9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:10.956089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e43b-03af-47d2-a29f-6745244d9ac3 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:10.957581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 672/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:10.963378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f8ca-c13e-4fa3-b445-7fa38acc8402 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:10.963907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f8ca-c13e-4fa3-b445-7fa38acc8402 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:10.964003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f8ca-c13e-4fa3-b445-7fa38acc8402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:10.982990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1d04f8ca-c13e-4fa3-b445-7fa38acc8402 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:10.984167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1d04f8ca-c13e-4fa3-b445-7fa38acc8402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:10.993516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 681/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:11.785526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=13 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:12.705736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac0fb-43e9-47cc-b92b-3b91eb3adc21 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:12.706386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac0fb-43e9-47cc-b92b-3b91eb3adc21 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:12.706386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac0fb-43e9-47cc-b92b-3b91eb3adc21 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:12.707648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 673/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:12.713014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc2ff-1a61-4df5-af0a-caf4cca53a42 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:12.713435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc2ff-1a61-4df5-af0a-caf4cca53a42 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:12.713567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc2ff-1a61-4df5-af0a-caf4cca53a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:12.732296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5dadc2ff-1a61-4df5-af0a-caf4cca53a42 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:12.733688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5dadc2ff-1a61-4df5-af0a-caf4cca53a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:12.742636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 682/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:32:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:16.362978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa9f0-f709-4ef1-bbd9-0ccf8b2fa48a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:16.363544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa9f0-f709-4ef1-bbd9-0ccf8b2fa48a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:16.363544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa9f0-f709-4ef1-bbd9-0ccf8b2fa48a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:16.364819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 674/1356] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:16.371150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb31d-a333-4b88-98ef-5865cd5a2aa6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:16.371638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb31d-a333-4b88-98ef-5865cd5a2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:16.371835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb31d-a333-4b88-98ef-5865cd5a2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:16.398350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-014cb31d-a333-4b88-98ef-5865cd5a2aa6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:16.399794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-014cb31d-a333-4b88-98ef-5865cd5a2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:16.409088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 683/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:16.462561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a452e-0a0b-41ac-bc9f-16d22f05f51c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:16.463328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a452e-0a0b-41ac-bc9f-16d22f05f51c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:16.464152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a452e-0a0b-41ac-bc9f-16d22f05f51c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:16.465888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 675/1358] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 23 13:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:16.475235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1b1e-8ee7-4eb2-9871-94aa4830396c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:16.475750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1b1e-8ee7-4eb2-9871-94aa4830396c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:16.476309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1b1e-8ee7-4eb2-9871-94aa4830396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:16.545887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:16.555073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c13a1b1e-8ee7-4eb2-9871-94aa4830396c None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:16.556561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c13a1b1e-8ee7-4eb2-9871-94aa4830396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:16.647587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 684/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 23 13:32:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:16.648690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a452e-0a0b-41ac-bc9f-16d22f05f51c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:16.664972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a452e-0a0b-41ac-bc9f-16d22f05f51c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:16.670864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:16.671635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:16.671979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:16.672316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:16.681122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:16.682840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9386-d82a-4174-9940-022e2cbeb10a service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:16.693125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 676/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:18.890667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858557-afd9-4845-80f1-6317b0a6216f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:18.891201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858557-afd9-4845-80f1-6317b0a6216f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:18.891201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858557-afd9-4845-80f1-6317b0a6216f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:18.892610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 685/1361] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:18.898078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8e4f-e05f-46cc-acd0-bf7a423ee72b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:18.898534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8e4f-e05f-46cc-acd0-bf7a423ee72b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:18.898638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8e4f-e05f-46cc-acd0-bf7a423ee72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:18.916777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6f0a8e4f-e05f-46cc-acd0-bf7a423ee72b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:18.917984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6f0a8e4f-e05f-46cc-acd0-bf7a423ee72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:18.926897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 677/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:18.971088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858557-afd9-4845-80f1-6317b0a6216f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:18.986457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858557-afd9-4845-80f1-6317b0a6216f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:18.992278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:18.992925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:18.993179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:18.993489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:19.003048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:19.005093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8738-b66f-4131-944b-3a87c748586d service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:19.015770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 686/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:21.340037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c406cd-c38d-49b7-94b7-88a1aa111f0d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:21.340507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c406cd-c38d-49b7-94b7-88a1aa111f0d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:21.340623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c406cd-c38d-49b7-94b7-88a1aa111f0d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:21.342142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 678/1364] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:21.347634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477d7f-f4e2-4cce-a370-1624874da674 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:21.348104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477d7f-f4e2-4cce-a370-1624874da674 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:21.348608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477d7f-f4e2-4cce-a370-1624874da674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:21.368319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f7477d7f-f4e2-4cce-a370-1624874da674 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:21.369477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f7477d7f-f4e2-4cce-a370-1624874da674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:21.378911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 687/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:21.422804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61716c-f847-4746-8fcf-fc249373ebe7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:21.423094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61716c-f847-4746-8fcf-fc249373ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:21.423499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61716c-f847-4746-8fcf-fc249373ebe7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:21.425659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 679/1366] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 23 13:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:21.433181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbe73-43d3-4c41-b909-61f46f5c6cdd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:21.433181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbe73-43d3-4c41-b909-61f46f5c6cdd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:21.433181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbe73-43d3-4c41-b909-61f46f5c6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:21.463619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c51bbe73-43d3-4c41-b909-61f46f5c6cdd None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:21.464775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c51bbe73-43d3-4c41-b909-61f46f5c6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:21.474999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 688/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 23 13:32:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:21.483176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61716c-f847-4746-8fcf-fc249373ebe7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:21.500126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61716c-f847-4746-8fcf-fc249373ebe7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:21.506507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:21.507222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:21.507588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:21.507927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:21.516299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:21.517959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acaf1c-d114-4894-9ce1-4b7f06eb9e6e service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:21.527746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 680/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:23.626162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18fb27-9e09-4d9d-b7df-9229ccfabd5a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:23.626704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18fb27-9e09-4d9d-b7df-9229ccfabd5a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:23.626704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18fb27-9e09-4d9d-b7df-9229ccfabd5a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:23.633928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf875-8ab2-4b57-bfd2-b4d70f991d42 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:23.634747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf875-8ab2-4b57-bfd2-b4d70f991d42 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:23.635184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf875-8ab2-4b57-bfd2-b4d70f991d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:23.637660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 689/1369] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:23.655066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fe5bf875-8ab2-4b57-bfd2-b4d70f991d42 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:23.656575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fe5bf875-8ab2-4b57-bfd2-b4d70f991d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:23.666162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 681/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:23.712778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18fb27-9e09-4d9d-b7df-9229ccfabd5a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:23.736622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18fb27-9e09-4d9d-b7df-9229ccfabd5a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:23.746043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:23.747297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:23.748105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:23.748653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:23.763777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:23.765724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4b651-2df9-4d09-bcc7-158d187a85f4 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:23.777707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 690/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:24.460647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6814cc-4c8a-4fab-86df-989824f33c00 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:24.461260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6814cc-4c8a-4fab-86df-989824f33c00 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:24.461823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6814cc-4c8a-4fab-86df-989824f33c00 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:24.468037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 682/1372] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:24.469965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c976-3526-4628-a2a6-4610caeb93ff None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:24.470432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c976-3526-4628-a2a6-4610caeb93ff None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:24.470876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c976-3526-4628-a2a6-4610caeb93ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:24.493779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1528c976-3526-4628-a2a6-4610caeb93ff None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:24.495177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1528c976-3526-4628-a2a6-4610caeb93ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:24.512503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 691/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:24.870319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade57e-6ce8-4678-9f36-71389867592c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:24.870319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade57e-6ce8-4678-9f36-71389867592c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:24.870319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade57e-6ce8-4678-9f36-71389867592c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:24.876025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 683/1374] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 23 13:32:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:24.883723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f128-2618-4a26-a25b-6e2283feb311 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:24.885459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f128-2618-4a26-a25b-6e2283feb311 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:24.885743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f128-2618-4a26-a25b-6e2283feb311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:24.953298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b690f128-2618-4a26-a25b-6e2283feb311 None None] MFA Rules not processed for user `e47a97beb009467b9b53222ba5a551fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:24.954959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b690f128-2618-4a26-a25b-6e2283feb311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:25.032200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 692/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 23 13:32:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:25.042012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade57e-6ce8-4678-9f36-71389867592c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:25.067512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade57e-6ce8-4678-9f36-71389867592c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:25.072674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:25.074117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:25.074873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:25.075816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:25.089452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:25.092285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4703-50ce-4743-9873-8507d0f545e8 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:25.105528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 684/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:25.941137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282833-a7bd-49c6-b128-82821e262590 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:25.941574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282833-a7bd-49c6-b128-82821e262590 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:25.941574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282833-a7bd-49c6-b128-82821e262590 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:25.947187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 693/1377] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:25.948431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9666-48a6-403a-845a-c23543625155 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:25.948847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9666-48a6-403a-845a-c23543625155 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:25.949010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9666-48a6-403a-845a-c23543625155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:25.982018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-789f9666-48a6-403a-845a-c23543625155 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:25.983235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-789f9666-48a6-403a-845a-c23543625155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:26.004845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 685/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:26.057243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282833-a7bd-49c6-b128-82821e262590 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:26.086078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282833-a7bd-49c6-b128-82821e262590 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:26.093824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:26.094865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:26.095269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:26.095653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:26.108407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:26.114053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be510a-eaf6-4c01-a62f-2c096e0034bc service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:26.118393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:26.127219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 694/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:28.269838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802d3b-f3f8-4605-a7fb-109c860534c9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:28.270314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802d3b-f3f8-4605-a7fb-109c860534c9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:28.270435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802d3b-f3f8-4605-a7fb-109c860534c9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:28.271796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 686/1380] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:32:28.277298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733f45-40b5-4717-8bb2-1517e050b098 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:28.277732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733f45-40b5-4717-8bb2-1517e050b098 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:28.277840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733f45-40b5-4717-8bb2-1517e050b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:28.296988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ea733f45-40b5-4717-8bb2-1517e050b098 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:28.298316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ea733f45-40b5-4717-8bb2-1517e050b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:28.310704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 695/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:28.355945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802d3b-f3f8-4605-a7fb-109c860534c9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:28.373584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802d3b-f3f8-4605-a7fb-109c860534c9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:28.380444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:28.381092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:28.381376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:28.382467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:28.391541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:28.394471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc84637-f943-41a4-a510-245332fc8abb service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:28.405467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 687/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:30.570741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69b7e-fe98-476a-8800-f6014f1d803a None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:30.571762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69b7e-fe98-476a-8800-f6014f1d803a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:30.572257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69b7e-fe98-476a-8800-f6014f1d803a None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:30.577924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 696/1383] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:30.579461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb972-bf7a-4e05-8e9e-72b76c283e49 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:30.579893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb972-bf7a-4e05-8e9e-72b76c283e49 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:30.580065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb972-bf7a-4e05-8e9e-72b76c283e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:30.598988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6d6eb972-bf7a-4e05-8e9e-72b76c283e49 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:30.600588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6d6eb972-bf7a-4e05-8e9e-72b76c283e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:30.611185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 688/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:30.655767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d69b7e-fe98-476a-8800-f6014f1d803a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:30.676235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d69b7e-fe98-476a-8800-f6014f1d803a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:30.684739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:30.685647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:30.685994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:30.686367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:30.697566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:30.699525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4519d-0b2a-48d8-8d9e-cb58587d5445 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:30.723078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 697/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:32.802450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa052-e172-4d98-8c65-f9f74885a269 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:32.803571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa052-e172-4d98-8c65-f9f74885a269 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:32.804088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa052-e172-4d98-8c65-f9f74885a269 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:32.805565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 689/1386] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:32.811042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f77d6-84ca-48f7-a508-d6d364c95f19 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:32.811538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f77d6-84ca-48f7-a508-d6d364c95f19 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:32.811652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f77d6-84ca-48f7-a508-d6d364c95f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:32.831597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f63f77d6-84ca-48f7-a508-d6d364c95f19 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:32.832933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f63f77d6-84ca-48f7-a508-d6d364c95f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:32.842168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 698/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:32.888718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa052-e172-4d98-8c65-f9f74885a269 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:32.903714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa052-e172-4d98-8c65-f9f74885a269 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:32.909207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:32.909850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:32.910131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:32.910393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:32.919468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:32.921078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e992f-78db-4194-8a7d-a1a7c2a0caee service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:32.931090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 690/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:32:34.960811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34edeb-3029-4b6a-9435-7448f867a575 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:34.961336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34edeb-3029-4b6a-9435-7448f867a575 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:34.961570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34edeb-3029-4b6a-9435-7448f867a575 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:34.963714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 699/1389] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:34.968752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f4dd-6c59-4702-a227-3018e59eac17 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:34.969176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f4dd-6c59-4702-a227-3018e59eac17 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:34.969306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f4dd-6c59-4702-a227-3018e59eac17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:34.991309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-83a9f4dd-6c59-4702-a227-3018e59eac17 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:34.992981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-83a9f4dd-6c59-4702-a227-3018e59eac17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:35.005520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 691/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:35.050191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34edeb-3029-4b6a-9435-7448f867a575 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:35.065453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34edeb-3029-4b6a-9435-7448f867a575 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:35.070765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:35.071422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:35.071718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:35.071974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:35.080215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:35.081842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b80d9-d145-4fed-8e01-c9be6006b3d4 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:35.093012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 700/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:37.431661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc202a-47e8-4cbf-b4e7-180512a79e20 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:37.432408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc202a-47e8-4cbf-b4e7-180512a79e20 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:37.432408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc202a-47e8-4cbf-b4e7-180512a79e20 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:37.433690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 692/1392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:37.440337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dc49-e419-4ca8-80e3-d43dff7a4501 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:37.440830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dc49-e419-4ca8-80e3-d43dff7a4501 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:37.441009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dc49-e419-4ca8-80e3-d43dff7a4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:37.462859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b5a8dc49-e419-4ca8-80e3-d43dff7a4501 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:37.464253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b5a8dc49-e419-4ca8-80e3-d43dff7a4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:37.473079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 701/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:32:37.517443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc202a-47e8-4cbf-b4e7-180512a79e20 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:37.534201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc202a-47e8-4cbf-b4e7-180512a79e20 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:37.540413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:37.541050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:37.541323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:37.541660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:37.550221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:37.551854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a82da-e8fa-452e-8f93-a767353ee3ad service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:37.561440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 693/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:39.639621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1720-5024-4f80-8754-d074c94c2b55 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:39.640208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1720-5024-4f80-8754-d074c94c2b55 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:39.640208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1720-5024-4f80-8754-d074c94c2b55 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:39.641574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 702/1395] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:39.647016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741ebc-1846-437a-be29-ff747cde5ee5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:39.647487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741ebc-1846-437a-be29-ff747cde5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:39.647620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741ebc-1846-437a-be29-ff747cde5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:39.666451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a4741ebc-1846-437a-be29-ff747cde5ee5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:39.667797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a4741ebc-1846-437a-be29-ff747cde5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:39.676432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 694/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:39.720637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1720-5024-4f80-8754-d074c94c2b55 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:39.737644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1720-5024-4f80-8754-d074c94c2b55 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:39.743718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:39.744364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:39.744785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:39.745095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:39.753683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:39.755253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f878d-c628-4ad9-aea1-73273df5fc4a service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:39.764919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 703/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:41.157677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b3d1-1ce1-4d24-9b31-575216236893 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.158271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b3d1-1ce1-4d24-9b31-575216236893 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.158271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b3d1-1ce1-4d24-9b31-575216236893 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.159659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 695/1398] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:41.164868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b5d4-6d09-4799-9ac9-62fcf0b8e820 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.165352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b5d4-6d09-4799-9ac9-62fcf0b8e820 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.165458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b5d4-6d09-4799-9ac9-62fcf0b8e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.185881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-47d3b5d4-6d09-4799-9ac9-62fcf0b8e820 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:41.187056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-47d3b5d4-6d09-4799-9ac9-62fcf0b8e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:41.195387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 704/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:41.250620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d399-feca-430b-80f3-32674ac5e30a None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.250907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d399-feca-430b-80f3-32674ac5e30a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.251182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d399-feca-430b-80f3-32674ac5e30a None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.252574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 696/1400] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 23 13:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:41.257692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68b88-215d-483f-a130-443c6f79d9b5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.257978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68b88-215d-483f-a130-443c6f79d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.258249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68b88-215d-483f-a130-443c6f79d9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.307309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3fe68b88-215d-483f-a130-443c6f79d9b5 None None] MFA Rules not processed for user `332b8759a3e8491a8a1319ce68e1d62c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:41.308626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3fe68b88-215d-483f-a130-443c6f79d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:41.371698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 705/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 23 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:41.379431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d399-feca-430b-80f3-32674ac5e30a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:41.391265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d399-feca-430b-80f3-32674ac5e30a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:41.395095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:41.396015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.396297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.396572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.405771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:41.407219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4a17-0196-4029-9bd2-fddd7b7e1d8f service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:41.416917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 697/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:41.799694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea634-d226-462d-9b09-e24bb8d0821b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.800023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea634-d226-462d-9b09-e24bb8d0821b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.800287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea634-d226-462d-9b09-e24bb8d0821b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.801747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 706/1403] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:41.807498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eca38-61f7-4117-9c9a-7417752af849 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.807912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eca38-61f7-4117-9c9a-7417752af849 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.808264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eca38-61f7-4117-9c9a-7417752af849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.815445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=61 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:41.829144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-303eca38-61f7-4117-9c9a-7417752af849 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:41.830604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-303eca38-61f7-4117-9c9a-7417752af849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:41.840258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 698/1404] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:41.884489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ea634-d226-462d-9b09-e24bb8d0821b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:41.899598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ea634-d226-462d-9b09-e24bb8d0821b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:41.905348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:41.906065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.906350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.906623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.915562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:41.917217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109732c8-8433-48e6-b301-0fd1d91ee774 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:41.926666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 707/1405] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:42.145149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd39e-3240-43df-b07e-027b6115cc2c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:42.145443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd39e-3240-43df-b07e-027b6115cc2c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:42.145722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd39e-3240-43df-b07e-027b6115cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:42.198404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d12cd39e-3240-43df-b07e-027b6115cc2c None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:42.199728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d12cd39e-3240-43df-b07e-027b6115cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:42.261964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 699/1406] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:32:42.305152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171def-c1b0-4e1f-8159-b3449237e623 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:42.305669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171def-c1b0-4e1f-8159-b3449237e623 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:42.305669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171def-c1b0-4e1f-8159-b3449237e623 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:42.307066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 708/1407] 10.222.0.26 () {54 vars in 942 bytes} [Thu Jun 23 13:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:42.313545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fba9-179c-4d5d-aafe-dd229c66d551 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:42.313822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fba9-179c-4d5d-aafe-dd229c66d551 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:42.314102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fba9-179c-4d5d-aafe-dd229c66d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:42.366342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0701fba9-179c-4d5d-aafe-dd229c66d551 None None] MFA Rules not processed for user `c2660c54018042e5af8535a2b7b5e9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:42.367495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0701fba9-179c-4d5d-aafe-dd229c66d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:42.453817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 700/1408] 10.222.0.26 () {58 vars in 1039 bytes} [Thu Jun 23 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:32:42.464363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7171def-c1b0-4e1f-8159-b3449237e623 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:42.479146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7171def-c1b0-4e1f-8159-b3449237e623 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:42.484384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:42.485025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:42.485310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:42.485586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:42.493630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:42.495261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a136-fd26-458e-bf0c-089af9ddc126 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:42.503278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 709/1409] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:32:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:32:52.450452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:52.500179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=81 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.631693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535ab-9da6-4667-b3cb-a2dabc3e746c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.632327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535ab-9da6-4667-b3cb-a2dabc3e746c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.632327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535ab-9da6-4667-b3cb-a2dabc3e746c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.634222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 701/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 23 13:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:04.640009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff5c6c-cabf-44b8-b60d-d9a91ffe5390 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.640397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff5c6c-cabf-44b8-b60d-d9a91ffe5390 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.640561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff5c6c-cabf-44b8-b60d-d9a91ffe5390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.660546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-41ff5c6c-cabf-44b8-b60d-d9a91ffe5390 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:04.661799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-41ff5c6c-cabf-44b8-b60d-d9a91ffe5390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:04.674817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 710/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 23 13:33:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:04.690331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81899d87-7c51-4af3-8da5-14b0bd33972e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.690775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81899d87-7c51-4af3-8da5-14b0bd33972e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.691224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81899d87-7c51-4af3-8da5-14b0bd33972e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.693432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 702/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 23 13:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:04.699838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97d0a-35dd-4fe7-a72d-fde1993b0df3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.700154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97d0a-35dd-4fe7-a72d-fde1993b0df3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.700423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97d0a-35dd-4fe7-a72d-fde1993b0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.718874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-85a97d0a-35dd-4fe7-a72d-fde1993b0df3 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:04.720081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-85a97d0a-35dd-4fe7-a72d-fde1993b0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:04.729917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 711/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 23 13:33:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:33:07.249190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591c5d-f552-4471-9190-24a117ab0cc9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.249809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591c5d-f552-4471-9190-24a117ab0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.249809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591c5d-f552-4471-9190-24a117ab0cc9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.251880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:07.259998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3daf00-d5c0-4406-b9f1-adb8ec4b8619 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.260470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3daf00-d5c0-4406-b9f1-adb8ec4b8619 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.260580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3daf00-d5c0-4406-b9f1-adb8ec4b8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.281616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1e3daf00-d5c0-4406-b9f1-adb8ec4b8619 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:07.282841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e3daf00-d5c0-4406-b9f1-adb8ec4b8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:07.293062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:07.342035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01591c5d-f552-4471-9190-24a117ab0cc9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.362518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01591c5d-f552-4471-9190-24a117ab0cc9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.371423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.372079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.372368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.372644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.381274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.382919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa21f9-7586-44b9-956d-5feb2a54d8b0 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.393919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 704/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:08.308508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d218-925d-45a5-b626-a3a2a51917a2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.309354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d218-925d-45a5-b626-a3a2a51917a2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.309354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d218-925d-45a5-b626-a3a2a51917a2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.311758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:08.319167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bb81-efc3-40c3-9e8b-07452faba30b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.319684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bb81-efc3-40c3-9e8b-07452faba30b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.319789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bb81-efc3-40c3-9e8b-07452faba30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.340000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3917bb81-efc3-40c3-9e8b-07452faba30b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:08.341209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3917bb81-efc3-40c3-9e8b-07452faba30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:08.350144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:08.501678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d218-925d-45a5-b626-a3a2a51917a2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.518369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d218-925d-45a5-b626-a3a2a51917a2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:08.525088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:08.525711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.526057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.526333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.535672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:08.537252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fe938-9c59-4a89-beda-7792122af914 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:08.546906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 714/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:09.464175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925790d4-eac2-41ff-a7eb-7798c98fd86d None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.464803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925790d4-eac2-41ff-a7eb-7798c98fd86d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.464803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925790d4-eac2-41ff-a7eb-7798c98fd86d None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.466113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:09.472173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52154-f113-43cc-a79f-c1cbe102085a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.472916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52154-f113-43cc-a79f-c1cbe102085a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.473067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52154-f113-43cc-a79f-c1cbe102085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.500807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f8e52154-f113-43cc-a79f-c1cbe102085a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:09.502037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f8e52154-f113-43cc-a79f-c1cbe102085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:09.511470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:09.663305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925790d4-eac2-41ff-a7eb-7798c98fd86d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.686522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925790d4-eac2-41ff-a7eb-7798c98fd86d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.692954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.693561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.693836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.694105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.703063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.704701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c95813-eb7b-4079-b10f-34889b3ba88e service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.714895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 707/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:10.570508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06aadf-2caf-463f-9ae6-81df8554abbf None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.571309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06aadf-2caf-463f-9ae6-81df8554abbf None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.571309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06aadf-2caf-463f-9ae6-81df8554abbf None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.573495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:10.579389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ceda9-5999-4e21-85be-f75d63e65395 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.580011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ceda9-5999-4e21-85be-f75d63e65395 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.580180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ceda9-5999-4e21-85be-f75d63e65395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.612274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0e9ceda9-5999-4e21-85be-f75d63e65395 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:10.613746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0e9ceda9-5999-4e21-85be-f75d63e65395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:10.623773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:10.778416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06aadf-2caf-463f-9ae6-81df8554abbf None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.797734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06aadf-2caf-463f-9ae6-81df8554abbf None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.804538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.805174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.805455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.805724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.814695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:10.816318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ceace5-6c75-4e19-91a1-d8dbe2e1ed59 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:10.826370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 717/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:11.672461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e3b2-60b7-4c9c-b1d2-e5e8a052e115 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.673075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e3b2-60b7-4c9c-b1d2-e5e8a052e115 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.673075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e3b2-60b7-4c9c-b1d2-e5e8a052e115 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.674426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:11.679553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d5b-70d9-437f-bcd3-afa5ca704318 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.680006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d5b-70d9-437f-bcd3-afa5ca704318 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.680110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d5b-70d9-437f-bcd3-afa5ca704318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.699327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-99213d5b-70d9-437f-bcd3-afa5ca704318 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:11.700539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-99213d5b-70d9-437f-bcd3-afa5ca704318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:11.709290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:11.861331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e3b2-60b7-4c9c-b1d2-e5e8a052e115 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.881287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e3b2-60b7-4c9c-b1d2-e5e8a052e115 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.887948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.888592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.888874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.889147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.898544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.900193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcf676-dd94-47dc-8433-7162a427daf0 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.910681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 710/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:12.716263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a504-399c-4f9c-af15-fb0327fb28d5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.716831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a504-399c-4f9c-af15-fb0327fb28d5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.716831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a504-399c-4f9c-af15-fb0327fb28d5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.718843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:12.725742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980404a2-c176-415b-ac62-89ec60a819f6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.726164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980404a2-c176-415b-ac62-89ec60a819f6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.726279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980404a2-c176-415b-ac62-89ec60a819f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.747439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-980404a2-c176-415b-ac62-89ec60a819f6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:12.748631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-980404a2-c176-415b-ac62-89ec60a819f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:12.757696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:12.906854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a504-399c-4f9c-af15-fb0327fb28d5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.922948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a504-399c-4f9c-af15-fb0327fb28d5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.929516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.930134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.930417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.930670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.939778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.941362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6d73-b241-4808-ac4d-4ec109d3466a service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.951360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 720/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:13.755015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f20-4867-48e3-9a67-fff1298901de None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.755727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f20-4867-48e3-9a67-fff1298901de None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.755727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f20-4867-48e3-9a67-fff1298901de None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.757150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:13.762598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece065-a2b2-4cfe-8e9c-c2334ad76011 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.763068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece065-a2b2-4cfe-8e9c-c2334ad76011 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.763179 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece065-a2b2-4cfe-8e9c-c2334ad76011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.783170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-13ece065-a2b2-4cfe-8e9c-c2334ad76011 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:13.784583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-13ece065-a2b2-4cfe-8e9c-c2334ad76011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:13.794527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:13.953967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303f20-4867-48e3-9a67-fff1298901de None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.973988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303f20-4867-48e3-9a67-fff1298901de None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.980611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.981242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.981522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.981765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.990214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.991896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6d652-5755-47ef-a91f-748bde81acb7 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:14.001552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 713/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:14.801916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3ed9-cceb-43d3-9412-50f84726ed21 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:14.802523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3ed9-cceb-43d3-9412-50f84726ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:14.802523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3ed9-cceb-43d3-9412-50f84726ed21 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:14.803968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:14.810001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033624a-e9be-452f-9bc1-561c7bb9002f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:14.810460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033624a-e9be-452f-9bc1-561c7bb9002f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:14.810583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033624a-e9be-452f-9bc1-561c7bb9002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:14.839473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8033624a-e9be-452f-9bc1-561c7bb9002f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:14.840699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8033624a-e9be-452f-9bc1-561c7bb9002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:14.849767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:15.004709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b3ed9-cceb-43d3-9412-50f84726ed21 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.023580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b3ed9-cceb-43d3-9412-50f84726ed21 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.030225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.030863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.031145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.031442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.043557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:15.045136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d5fa-c6c6-449e-bc7a-b247f01a4713 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:15.055100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 723/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:15.859854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1bb88-7b8c-4d70-8d82-6ab111a138eb None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.860453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1bb88-7b8c-4d70-8d82-6ab111a138eb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.860453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1bb88-7b8c-4d70-8d82-6ab111a138eb None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.861801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:15.867861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cf76-1d62-462a-bda3-f31096b33316 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.868300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cf76-1d62-462a-bda3-f31096b33316 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.868433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cf76-1d62-462a-bda3-f31096b33316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.893624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-52f2cf76-1d62-462a-bda3-f31096b33316 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:15.894836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-52f2cf76-1d62-462a-bda3-f31096b33316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:15.903658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:16.059626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1bb88-7b8c-4d70-8d82-6ab111a138eb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.080666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1bb88-7b8c-4d70-8d82-6ab111a138eb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.087129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.087816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.088095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.088370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.097242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.098879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c751cbe-56ce-4a11-992c-a30bcfd2b453 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.109005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 716/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:18.042772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.043403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.043403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.044717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:18.051126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab59c-baba-46e0-acd1-8badb8b3ac29 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.051905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab59c-baba-46e0-acd1-8badb8b3ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.052052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab59c-baba-46e0-acd1-8badb8b3ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.078256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2d1ab59c-baba-46e0-acd1-8badb8b3ac29 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:18.080341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d1ab59c-baba-46e0-acd1-8badb8b3ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:18.092190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:18.131475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.133660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:18.147621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe4f75-a2cc-4522-963d-a0786000295e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:18.151181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:18.151856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.152138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.152413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.161482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:18.162914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f231ff-bd10-47fb-a9ff-7fcc0eda628f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:18.172701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 726/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:20.348086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00eea-3c86-44a4-afd6-66e2c6ac244c None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.348692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00eea-3c86-44a4-afd6-66e2c6ac244c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.348692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00eea-3c86-44a4-afd6-66e2c6ac244c None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.349951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:20.356751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2153f-6b5e-4fc8-8809-3bd82ea74f96 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.357418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2153f-6b5e-4fc8-8809-3bd82ea74f96 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.357574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2153f-6b5e-4fc8-8809-3bd82ea74f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.387150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-39b2153f-6b5e-4fc8-8809-3bd82ea74f96 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:20.388391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-39b2153f-6b5e-4fc8-8809-3bd82ea74f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:20.397667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:20.435959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00eea-3c86-44a4-afd6-66e2c6ac244c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.451805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00eea-3c86-44a4-afd6-66e2c6ac244c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.455822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.456480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.456756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.457028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.467054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:20.468540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ea84d-eb48-4051-9c5a-f44fe724ba70 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:20.478400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 719/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:22.873729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4ec3-145e-4a54-87e2-2c2faea6834e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.874212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4ec3-145e-4a54-87e2-2c2faea6834e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.874419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4ec3-145e-4a54-87e2-2c2faea6834e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.875719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:22.881453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d5be-8f02-4be8-8f95-2b12c5902d16 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.881903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d5be-8f02-4be8-8f95-2b12c5902d16 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.882004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d5be-8f02-4be8-8f95-2b12c5902d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.902601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3ac4d5be-8f02-4be8-8f95-2b12c5902d16 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:22.903967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ac4d5be-8f02-4be8-8f95-2b12c5902d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:22.913204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:22.957369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c4ec3-145e-4a54-87e2-2c2faea6834e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.971366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c4ec3-145e-4a54-87e2-2c2faea6834e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.975461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.976105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.976383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.976653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.986435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:22.988045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c2fc-37f6-485f-b446-0ff8c0b9ef8a service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:22.997990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 729/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:25.148282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9647b-414f-49f2-b7ab-86cc8dd27436 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.148964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9647b-414f-49f2-b7ab-86cc8dd27436 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.149123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9647b-414f-49f2-b7ab-86cc8dd27436 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.151116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:25.156633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329e2a-a9c1-46a4-aaca-270f246aca5c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.157078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329e2a-a9c1-46a4-aaca-270f246aca5c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.157183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329e2a-a9c1-46a4-aaca-270f246aca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.176618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7b329e2a-a9c1-46a4-aaca-270f246aca5c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:25.177844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7b329e2a-a9c1-46a4-aaca-270f246aca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:25.187978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:25.229257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9647b-414f-49f2-b7ab-86cc8dd27436 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.246314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9647b-414f-49f2-b7ab-86cc8dd27436 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:25.251214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:25.251871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.252154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.252427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.262190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:25.263867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7c61d-463b-46fd-9f4c-8edced4982a0 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:25.273615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 722/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:27.333947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53305a-fd5e-40e8-af32-7766a6397a09 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.334534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53305a-fd5e-40e8-af32-7766a6397a09 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.334534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53305a-fd5e-40e8-af32-7766a6397a09 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.337177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:27.346058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814ada4-6ab0-4036-9b6b-407a85375f84 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.346481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814ada4-6ab0-4036-9b6b-407a85375f84 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.346719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814ada4-6ab0-4036-9b6b-407a85375f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.368173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6814ada4-6ab0-4036-9b6b-407a85375f84 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:27.369369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6814ada4-6ab0-4036-9b6b-407a85375f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:27.379394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:27.420497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53305a-fd5e-40e8-af32-7766a6397a09 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.436716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53305a-fd5e-40e8-af32-7766a6397a09 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.441015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.441677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.441961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.442249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.452004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.453450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70090b30-f0de-4db1-9610-b873ed0e17d9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.463514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 732/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:29.536108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5354-ff02-4e94-a370-5e9eeffbe3c8 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.537070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5354-ff02-4e94-a370-5e9eeffbe3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.537070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5354-ff02-4e94-a370-5e9eeffbe3c8 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.539313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:29.548405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2433-42fc-4d59-9958-b9d42ed57ea8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.548851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2433-42fc-4d59-9958-b9d42ed57ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.548950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2433-42fc-4d59-9958-b9d42ed57ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.572173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-509a2433-42fc-4d59-9958-b9d42ed57ea8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:29.573429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-509a2433-42fc-4d59-9958-b9d42ed57ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:29.582573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:29.623354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5354-ff02-4e94-a370-5e9eeffbe3c8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.637071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5354-ff02-4e94-a370-5e9eeffbe3c8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.641762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.642408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.642696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.642975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.652670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.654130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51719-545e-46b5-aba7-8a719d41c50c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.663848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 725/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:31.744269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9044-35ea-47ad-8455-e5dc1c734673 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:31.745212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9044-35ea-47ad-8455-e5dc1c734673 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:31.745212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9044-35ea-47ad-8455-e5dc1c734673 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:31.747426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:31.754045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c1e-6edd-4387-a113-56393c61b112 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:31.754767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c1e-6edd-4387-a113-56393c61b112 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:31.754901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c1e-6edd-4387-a113-56393c61b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:31.777075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e48b9c1e-6edd-4387-a113-56393c61b112 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:31.778333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e48b9c1e-6edd-4387-a113-56393c61b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:31.787996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:31.827468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9044-35ea-47ad-8455-e5dc1c734673 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:31.842175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9044-35ea-47ad-8455-e5dc1c734673 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:31.846877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:31.847577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:31.847869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:31.848154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:31.858178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:31.859745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab56f4-1a53-4a2e-9784-2bc9edf35bbd service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:31.869537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 735/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:33.946329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5770a-2958-422a-ba25-796c77ed2004 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.946914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5770a-2958-422a-ba25-796c77ed2004 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.946914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5770a-2958-422a-ba25-796c77ed2004 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.948361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:33.954654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3358-0a52-4fe9-9bcd-cbd98e086187 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.955460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3358-0a52-4fe9-9bcd-cbd98e086187 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.955692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3358-0a52-4fe9-9bcd-cbd98e086187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.966513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=79 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.981420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b60f3358-0a52-4fe9-9bcd-cbd98e086187 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:33.982608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b60f3358-0a52-4fe9-9bcd-cbd98e086187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:33.991402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:34.032381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5770a-2958-422a-ba25-796c77ed2004 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.042401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=73 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.052464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5770a-2958-422a-ba25-796c77ed2004 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.058495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.059400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.059776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.060118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.076421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.077901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8d9f-9dca-450e-adaf-431693ea746a service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.087875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 728/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:36.127396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117de76-83b2-42dc-a3bd-fb714e0c15e9 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.127877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117de76-83b2-42dc-a3bd-fb714e0c15e9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.127974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117de76-83b2-42dc-a3bd-fb714e0c15e9 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.130093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:36.135367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000a76-2946-4f06-acc2-d74e6beac03f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.135917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000a76-2946-4f06-acc2-d74e6beac03f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.136030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000a76-2946-4f06-acc2-d74e6beac03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.155287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c0000a76-2946-4f06-acc2-d74e6beac03f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:36.156518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c0000a76-2946-4f06-acc2-d74e6beac03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:36.165279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:36.202234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117de76-83b2-42dc-a3bd-fb714e0c15e9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.215174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117de76-83b2-42dc-a3bd-fb714e0c15e9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.219373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.220028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.220312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.220583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.230748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.232212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abf84d-855e-42a9-88a6-ef24f92661ce service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.241680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 738/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:38.268322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6406-fd4b-487b-ab46-44a477d21d11 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.268908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6406-fd4b-487b-ab46-44a477d21d11 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.268908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6406-fd4b-487b-ab46-44a477d21d11 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.270266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:38.275876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66ab8-7864-402f-addc-b668e1a1ad4b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.276332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66ab8-7864-402f-addc-b668e1a1ad4b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.276443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66ab8-7864-402f-addc-b668e1a1ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.296031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c5c66ab8-7864-402f-addc-b668e1a1ad4b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:38.297238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c5c66ab8-7864-402f-addc-b668e1a1ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:38.306313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:38.343400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6406-fd4b-487b-ab46-44a477d21d11 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.359896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6406-fd4b-487b-ab46-44a477d21d11 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.363948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.364585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.364871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.365184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.374706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:38.376189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59b847-62d7-4ca9-9a41-d3aa65045357 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:38.385644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 731/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:48.289967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=11 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.381533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=14 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:57.971368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021535-1ddf-4dfa-915d-44b58a13e8c2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.972022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021535-1ddf-4dfa-915d-44b58a13e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.972022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021535-1ddf-4dfa-915d-44b58a13e8c2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.973336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 740/1471] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:57.979827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad710e2a-3034-4b11-a503-ab2e2c6dc630 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.980279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad710e2a-3034-4b11-a503-ab2e2c6dc630 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.980386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad710e2a-3034-4b11-a503-ab2e2c6dc630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.004696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ad710e2a-3034-4b11-a503-ab2e2c6dc630 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:58.006484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ad710e2a-3034-4b11-a503-ab2e2c6dc630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:58.016448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 732/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:58.071322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb065f-ab68-40a9-9b26-9939e1b52635 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.071698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb065f-ab68-40a9-9b26-9939e1b52635 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.071970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb065f-ab68-40a9-9b26-9939e1b52635 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.073430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 741/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 23 13:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:58.078981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a2523-0151-4030-9ef2-4c56d8c23e5f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.079390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a2523-0151-4030-9ef2-4c56d8c23e5f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.079762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a2523-0151-4030-9ef2-4c56d8c23e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.105098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d96a2523-0151-4030-9ef2-4c56d8c23e5f None None] MFA Rules not processed for user `332b8759a3e8491a8a1319ce68e1d62c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:58.106289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d96a2523-0151-4030-9ef2-4c56d8c23e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:58.113513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 733/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 23 13:33:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:33:58.121097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb065f-ab68-40a9-9b26-9939e1b52635 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.135140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb065f-ab68-40a9-9b26-9939e1b52635 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.138955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.139643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.139930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.140206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.149611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:58.151164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa38-e858-47e0-9af6-90450a50f6c0 service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:58.160495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 742/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:00.258041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033a088-229c-47e6-b5ce-621a15ddc519 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.258598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033a088-229c-47e6-b5ce-621a15ddc519 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.258598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033a088-229c-47e6-b5ce-621a15ddc519 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.259992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 734/1476] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:00.265672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b58e47-c76c-4d4e-b2e5-9f8a7ced47c7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.266137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b58e47-c76c-4d4e-b2e5-9f8a7ced47c7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.266244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b58e47-c76c-4d4e-b2e5-9f8a7ced47c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.288877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d4b58e47-c76c-4d4e-b2e5-9f8a7ced47c7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:00.290809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d4b58e47-c76c-4d4e-b2e5-9f8a7ced47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:00.300674 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 743/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:34:00.324427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033a088-229c-47e6-b5ce-621a15ddc519 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.344507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033a088-229c-47e6-b5ce-621a15ddc519 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.352007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.352897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.353282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.353600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.354622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.356450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:34:00.356450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:34:00.356450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:34:00.357576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca310e24-12bf-4ef7-a55c-757a3991974a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.377191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 735/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/projects => generated 2553 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:02.440427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5998f-10e5-476a-834c-408d9570824e None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.441021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5998f-10e5-476a-834c-408d9570824e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.441021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5998f-10e5-476a-834c-408d9570824e None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.442378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 744/1479] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:02.448920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ab3a-09ac-44d9-8c6b-2ed405ec96e6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.449391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ab3a-09ac-44d9-8c6b-2ed405ec96e6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.449561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ab3a-09ac-44d9-8c6b-2ed405ec96e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.470481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-73e1ab3a-09ac-44d9-8c6b-2ed405ec96e6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:02.471694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-73e1ab3a-09ac-44d9-8c6b-2ed405ec96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:02.481119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 736/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:34:02.523425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5998f-10e5-476a-834c-408d9570824e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.538963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5998f-10e5-476a-834c-408d9570824e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.545067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.545710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.545993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.546272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.555031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.556668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193dde5-21dc-40df-b151-b6918f943d5e service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.566839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 745/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:04.780306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ac2f-38b8-4aa2-b2da-af66b3e46aa7 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.781194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ac2f-38b8-4aa2-b2da-af66b3e46aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.781194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ac2f-38b8-4aa2-b2da-af66b3e46aa7 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.783411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 737/1482] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:04.791384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a3e9-df37-467f-b25b-bd9239a6a52b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.791932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a3e9-df37-467f-b25b-bd9239a6a52b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.792029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a3e9-df37-467f-b25b-bd9239a6a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.810196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6863a3e9-df37-467f-b25b-bd9239a6a52b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:04.811376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6863a3e9-df37-467f-b25b-bd9239a6a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:04.819716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 746/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:34:04.855853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23ac2f-38b8-4aa2-b2da-af66b3e46aa7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.869590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23ac2f-38b8-4aa2-b2da-af66b3e46aa7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.873934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.874561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.874839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.875173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.884618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.886056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce30231-34b8-4c45-b69f-46e152a36c1f service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.895720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 738/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:06.964289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22bfef-e142-408d-9586-392cea50c0bd None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.964816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22bfef-e142-408d-9586-392cea50c0bd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.964816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22bfef-e142-408d-9586-392cea50c0bd None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.966994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 747/1485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:06.973338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa1b1-14b5-467d-abdc-060802c69f5a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.974075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa1b1-14b5-467d-abdc-060802c69f5a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.974234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa1b1-14b5-467d-abdc-060802c69f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.994602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d52fa1b1-14b5-467d-abdc-060802c69f5a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:06.995930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d52fa1b1-14b5-467d-abdc-060802c69f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:07.004173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 739/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:34:07.044834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22bfef-e142-408d-9586-392cea50c0bd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.058530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22bfef-e142-408d-9586-392cea50c0bd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.062802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.063613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.063901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.064178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.076655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.078082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf917e-478f-48b5-9541-13550a093bf4 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.088377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 748/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:09.312840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c6b-33af-43fe-a055-708603dee0ff None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.313680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c6b-33af-43fe-a055-708603dee0ff None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.313680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c6b-33af-43fe-a055-708603dee0ff None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.316013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 740/1488] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:09.322479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8361-2187-4e3d-961b-2a42046831ef None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.323129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8361-2187-4e3d-961b-2a42046831ef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.323306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8361-2187-4e3d-961b-2a42046831ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.342963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0eaf8361-2187-4e3d-961b-2a42046831ef None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:09.344213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0eaf8361-2187-4e3d-961b-2a42046831ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:09.352587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 749/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:34:09.396347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235c6b-33af-43fe-a055-708603dee0ff None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.408207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235c6b-33af-43fe-a055-708603dee0ff None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.411996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.412623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.412904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.413178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.422382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.423854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59d37-5ea0-41a5-8b67-af880fa191f4 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.433457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 741/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:34:11.628913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d90b-878d-4aeb-a2b5-aabf0d978774 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.629839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d90b-878d-4aeb-a2b5-aabf0d978774 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.629839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d90b-878d-4aeb-a2b5-aabf0d978774 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.632103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 750/1491] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 23 13:34:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:11.640442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb1e-e777-471a-b88b-5e2bcb1d2aed None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.641127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb1e-e777-471a-b88b-5e2bcb1d2aed None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.641320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb1e-e777-471a-b88b-5e2bcb1d2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.664152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a8d5cb1e-e777-471a-b88b-5e2bcb1d2aed None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:11.665370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a8d5cb1e-e777-471a-b88b-5e2bcb1d2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:11.674535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 742/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:34:11.716206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8d90b-878d-4aeb-a2b5-aabf0d978774 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.734004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8d90b-878d-4aeb-a2b5-aabf0d978774 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.740032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.740954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.741309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.741650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.752116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.753544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cecd0f-2733-4126-bb09-66ebcbd23d88 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.763110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 751/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:21.658548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=33 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:21.758799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=33 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:35.733875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.734488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.734488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.756754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:35.757966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:35.766983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 743/1494] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:35:35.780141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.780671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.780797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.808320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:35.809512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:35.818899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 752/1495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:35:35.823560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:35.833779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d990dc-d8c1-4d7d-ae86-a44560fc9e30 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:35.839940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:35.840596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.840878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.841144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.841924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:35.842226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:35.843240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:35.843240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:35:35.843240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:35:35.844174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:35.856352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 744/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:35.864517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:35.874172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05ce72-ca45-4d5c-8733-ca19c113679b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:35.880107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:35.880766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.881041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.881317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.882041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:35.883912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:35.883912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:35:35.883912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:35:35.885178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:35.925509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 753/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:35.930195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:35.940413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6886-1999-43d8-84d0-e7fa6f4450cb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.007867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.008767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.009218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.009677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.010359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.011432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:36.011432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:35:36.011432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:35:36.012645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.035937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 745/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:35:36.040217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.050470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362e1a-ebbd-473f-8e54-7c4d90921a6e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.055065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.055759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.056041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.056318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.057053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.058093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:36.058093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:35:36.058093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:35:36.058967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.072162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 754/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:35:36.076347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.086519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29691a8-a0e9-4ee7-8610-4c9a222688b9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.092887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.093554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.093832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.094086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.094812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.095928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:36.095928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:35:36.095928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:35:36.096805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4b92a-833d-4aea-981a-19edf099d218 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.111177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 746/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:35:36.115654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.126359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffe66f-cc41-4c04-8cb9-d1e6061edfc3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.131782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.132672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.132953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.133234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] PATH_INFO: `/v3/projects/9541b27156af49919135c29612ea5891/users/4d9cd8edc3e643598d5bc591e7857c6b/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.149047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9541b27156af49919135c29612ea5891, user_id=4d9cd8edc3e643598d5bc591e7857c6b, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.150086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:36.150086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:35:36.150086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:35:36.152045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aff59-4a9f-481b-86c1-1c22002fcda7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.168330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 755/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:35:36 2022] PUT /identity/v3/projects/9541b27156af49919135c29612ea5891/users/4d9cd8edc3e643598d5bc591e7857c6b/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:36.179779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31567-c455-4183-9860-ea54dd909b5e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.180086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31567-c455-4183-9860-ea54dd909b5e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.180358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31567-c455-4183-9860-ea54dd909b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.208750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8ee31567-c455-4183-9860-ea54dd909b5e None None] MFA Rules not processed for user `4d9cd8edc3e643598d5bc591e7857c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:36.209966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8ee31567-c455-4183-9860-ea54dd909b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:36.277879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 747/1502] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:35:36.291065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ebf54-986d-4e30-be01-aa4348d4bd3f None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.291371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ebf54-986d-4e30-be01-aa4348d4bd3f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.291658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ebf54-986d-4e30-be01-aa4348d4bd3f None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.293064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 756/1503] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 23 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:36.297822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74d0a-4b82-4248-b46f-2ccb0dd22ec9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.298111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74d0a-4b82-4248-b46f-2ccb0dd22ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.298396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74d0a-4b82-4248-b46f-2ccb0dd22ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.318823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0ed74d0a-4b82-4248-b46f-2ccb0dd22ec9 None None] MFA Rules not processed for user `e47a97beb009467b9b53222ba5a551fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:36.320057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0ed74d0a-4b82-4248-b46f-2ccb0dd22ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:36.370246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:36.381086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 748/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 23 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:35:36.389140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ebf54-986d-4e30-be01-aa4348d4bd3f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.404404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ebf54-986d-4e30-be01-aa4348d4bd3f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.408141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.408773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.409056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.409328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.417564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.418983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.427621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 757/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:35:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:35:36.474361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a427c4-1812-4896-886b-9448ecc84edf None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.474651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a427c4-1812-4896-886b-9448ecc84edf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.474928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a427c4-1812-4896-886b-9448ecc84edf None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.476295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 749/1506] 10.222.0.26 () {52 vars in 829 bytes} [Thu Jun 23 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:36.480019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.548262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a2f66-b686-48fc-9c73-eaf453ec14c9 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.556534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.557444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.557728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.558007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] PATH_INFO: `/v3/users/4d9cd8edc3e643598d5bc591e7857c6b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.559503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9cd8edc3e643598d5bc591e7857c6b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.560628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:36.560628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:35:36.560628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:35:36.561849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:36.632607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9cd8edc3e643598d5bc591e7857c6b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:36.645400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9cd8edc3e643598d5bc591e7857c6b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:36.646325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9cd8edc3e643598d5bc591e7857c6b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:36.658563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9cd8edc3e643598d5bc591e7857c6b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:36.659380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9cd8edc3e643598d5bc591e7857c6b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:36.683005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:36.692782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 758/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:35:36 2022] DELETE /identity/v3/users/4d9cd8edc3e643598d5bc591e7857c6b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:36.697344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.697633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.697908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.716877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:36.718066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:36.776531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 750/1508] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:35:36.786154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:36.787695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:36.978154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79880c-3856-46ee-99e4-74f948e9a5ee admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:36.982353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:36.982994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:36.983269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:36.983584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:36.993282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:36.994717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12078d5a-bcba-4af2-86bd-ca58925d2f1f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:37.005173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 759/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:35:37.370709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:37.372161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:37.384242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646071-ee39-449b-80bb-5dcb3ff4a4a9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:37.390789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:37.391674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:37.391992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:37.392257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] PATH_INFO: `/v3/projects/9541b27156af49919135c29612ea5891` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:37.394543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9541b27156af49919135c29612ea5891)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:37.395627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:35:37.395627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:35:37.395627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:35:37.396828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:37.460111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9541b27156af49919135c29612ea5891', 'request_id': 'req-5e374d28-4916-4c30-adaa-8cac332dd2fd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:37.470586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9541b27156af49919135c29612ea5891', 'request_id': 'req-5e374d28-4916-4c30-adaa-8cac332dd2fd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:37.476876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9541b27156af49919135c29612ea5891', 'request_id': 'req-5e374d28-4916-4c30-adaa-8cac332dd2fd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:37.495031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] The token cache is being invalidate because project 9541b27156af49919135c29612ea5891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:35:37.495317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:37.496127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e374d28-4916-4c30-adaa-8cac332dd2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:35:37.497735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 751/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:35:37 2022] DELETE /identity/v3/projects/9541b27156af49919135c29612ea5891 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:46.999949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:47.492108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:16.768236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:16.768865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:16.768865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:16.770184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:16.776173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aad3c-0db3-4a1a-8ad6-dd6e7fcd3ea0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:16.776889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aad3c-0db3-4a1a-8ad6-dd6e7fcd3ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:16.777043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aad3c-0db3-4a1a-8ad6-dd6e7fcd3ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:16.803893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-290aad3c-0db3-4a1a-8ad6-dd6e7fcd3ea0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:16.805665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-290aad3c-0db3-4a1a-8ad6-dd6e7fcd3ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:16.864781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:17.021164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:17.023056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:17.106685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32af36-34b5-4f5d-ada5-03cef9b96641 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:17.112561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:17.113212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.113495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.113800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.122537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:17.124176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a268b9-a00c-42d6-a0f1-1dea64ff5d62 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:17.133780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 761/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:17.946509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c91f-9d1f-4f3a-8687-69581a3c90c9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.947063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c91f-9d1f-4f3a-8687-69581a3c90c9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.947063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13c91f-9d1f-4f3a-8687-69581a3c90c9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.948485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:17.954550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b62dc-74e7-4e12-994e-a2180f5cf8e1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.955283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b62dc-74e7-4e12-994e-a2180f5cf8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.955506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b62dc-74e7-4e12-994e-a2180f5cf8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.984198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ed7b62dc-74e7-4e12-994e-a2180f5cf8e1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:17.986024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ed7b62dc-74e7-4e12-994e-a2180f5cf8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:17.995461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:18.151694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13c91f-9d1f-4f3a-8687-69581a3c90c9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:18.173388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13c91f-9d1f-4f3a-8687-69581a3c90c9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:18.180373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:18.181011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:18.181293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:18.181570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:18.190257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:18.191940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918204d1-1bbc-4751-8f6a-52087dc697b2 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:18.201377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 754/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:18.724223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5a43-06a4-4e8a-a4d0-f7fadfa03bc5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:18.724508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5a43-06a4-4e8a-a4d0-f7fadfa03bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:18.724760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5a43-06a4-4e8a-a4d0-f7fadfa03bc5 None None] PATH_INFO: `/v3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:18.726075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 763/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jun 23 13:37:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:18.732665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252de6-e0a5-4696-8fea-45d65011d2d2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:18.732960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252de6-e0a5-4696-8fea-45d65011d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:18.733238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252de6-e0a5-4696-8fea-45d65011d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:18.753002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-88252de6-e0a5-4696-8fea-45d65011d2d2 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:18.754234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-88252de6-e0a5-4696-8fea-45d65011d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:18.819182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 755/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 23 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:22.673183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8f97-809a-4246-b5cc-7fc6b678de26 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:22.674087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8f97-809a-4246-b5cc-7fc6b678de26 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:22.674087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8f97-809a-4246-b5cc-7fc6b678de26 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:22.676780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 764/1519] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 23 13:37:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:22.682631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9105-a9f9-47ec-bf8d-61c8989922ff None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:22.683111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9105-a9f9-47ec-bf8d-61c8989922ff None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:22.683218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9105-a9f9-47ec-bf8d-61c8989922ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:22.703843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-194e9105-a9f9-47ec-bf8d-61c8989922ff None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:22.705078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-194e9105-a9f9-47ec-bf8d-61c8989922ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:22.714642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 756/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 23 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:22.722345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e8f97-809a-4246-b5cc-7fc6b678de26 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:22.735481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e8f97-809a-4246-b5cc-7fc6b678de26 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:22.740501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:22.741204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:22.741474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:22.741764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:22.749935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:22.751533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684bd88-62e3-4968-be56-e8e61ffbd923 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:22.761110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 765/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:29.444409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d847f1-53a6-48ca-854b-fa251d7c3f91 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:29.445358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d847f1-53a6-48ca-854b-fa251d7c3f91 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:29.445358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d847f1-53a6-48ca-854b-fa251d7c3f91 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:29.447552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:29.455834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae86f-f19b-4bdf-b921-10516b6e730f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:29.456276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae86f-f19b-4bdf-b921-10516b6e730f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:29.456411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae86f-f19b-4bdf-b921-10516b6e730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:29.478372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6ffae86f-f19b-4bdf-b921-10516b6e730f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:29.479614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6ffae86f-f19b-4bdf-b921-10516b6e730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:29.490049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:29.651104 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d847f1-53a6-48ca-854b-fa251d7c3f91 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:29.672841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d847f1-53a6-48ca-854b-fa251d7c3f91 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:29.679546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:29.680196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:29.680490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:29.680772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:29.689346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:29.690977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cbf5a-a972-44c5-95a6-a1e5b958903a service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:29.700787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 758/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:30.500237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35d5b-9c4a-4f37-92a5-0a70c4a9e249 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:30.501110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35d5b-9c4a-4f37-92a5-0a70c4a9e249 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:30.501110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35d5b-9c4a-4f37-92a5-0a70c4a9e249 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:30.503391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:37:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:30.508395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33b93-d6ff-4440-b755-b2f1a6d1d4ea None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:30.508844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33b93-d6ff-4440-b755-b2f1a6d1d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:30.508950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33b93-d6ff-4440-b755-b2f1a6d1d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:30.527066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c9a33b93-d6ff-4440-b755-b2f1a6d1d4ea None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:30.528253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c9a33b93-d6ff-4440-b755-b2f1a6d1d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:30.536288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:30.687105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35d5b-9c4a-4f37-92a5-0a70c4a9e249 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:30.705388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35d5b-9c4a-4f37-92a5-0a70c4a9e249 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:30.712045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:30.713070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:30.713350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:30.713621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:30.722186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:30.723895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4850ab9-f9b3-4fe1-b8d0-dcf575fc2dbb service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:30.733625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 768/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:34.730834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:34.731479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:34.731479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:34.732785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:34.739563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c920-b05d-409f-945c-8e2c904e4f18 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:34.740322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c920-b05d-409f-945c-8e2c904e4f18 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:34.740483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c920-b05d-409f-945c-8e2c904e4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:34.761010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2ee8c920-b05d-409f-945c-8e2c904e4f18 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:34.762185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2ee8c920-b05d-409f-945c-8e2c904e4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:34.770786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:34.806742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:34.808823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:34.873924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e0b0b-5c05-4802-85ef-8320043b3ee0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:34.877763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:34.878412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:34.878698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:34.878982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:34.888214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:34.889686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a4db1-155b-48b8-8429-7ec0ba0b4f01 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:34.894878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:34.900187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 761/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:36.897981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5736-ae24-4692-a62f-72f4c2bdf496 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:36.898910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5736-ae24-4692-a62f-72f4c2bdf496 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:36.898910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5736-ae24-4692-a62f-72f4c2bdf496 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:36.900404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:36.905849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399736-c9e4-4890-a64d-1262f8dcd5a5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:36.906292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399736-c9e4-4890-a64d-1262f8dcd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:36.906394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399736-c9e4-4890-a64d-1262f8dcd5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:36.927769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98399736-c9e4-4890-a64d-1262f8dcd5a5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:36.928967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98399736-c9e4-4890-a64d-1262f8dcd5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:36.937558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:36.976795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5736-ae24-4692-a62f-72f4c2bdf496 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:36.994776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5736-ae24-4692-a62f-72f4c2bdf496 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:36.998959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:36.999614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:36.999890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:37.000160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:37.009950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:37.011411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62256-74fe-4d1f-a76d-48f162f596e4 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:37.021031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 771/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:40.571447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:40.572042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:40.572042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:40.573417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:40.579752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0042ba-1848-4ef0-87b6-25455e058cb9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:40.580497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0042ba-1848-4ef0-87b6-25455e058cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:40.580676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0042ba-1848-4ef0-87b6-25455e058cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:40.602710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7f0042ba-1848-4ef0-87b6-25455e058cb9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:40.603980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f0042ba-1848-4ef0-87b6-25455e058cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:40.613200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:40.918385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:40.920788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:40.995861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39932d-01eb-4aac-b227-a306df0f39ae None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:41.000090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:41.000745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:41.001030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:41.001309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:41.011378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:41.012822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d33c-b897-4e97-a97b-35413ffad913 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:41.022598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 764/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:43.063399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:43.064204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:43.064361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:43.066134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:37:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:43.074848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec5f8-e152-432f-bcb9-ddb188a249b5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:43.075599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec5f8-e152-432f-bcb9-ddb188a249b5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:43.075745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec5f8-e152-432f-bcb9-ddb188a249b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:43.102973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f71ec5f8-e152-432f-bcb9-ddb188a249b5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:43.104210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f71ec5f8-e152-432f-bcb9-ddb188a249b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:43.112934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:37:43.408189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:43.410376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:43.425584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3b795-726b-49bc-885f-970bd580ebf5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:43.429390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:43.430032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:43.430317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:43.430597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:43.442130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:43.443567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bda7d1-bbd3-422e-a1aa-9b1ce59975e7 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:43.453395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 774/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:53.097187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=32 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:53.449056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=70 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:09.809631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.810297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.810297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.832408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:09.833620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:09.843616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 766/1540] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:09.854443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.855027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.855027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.881862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:09.883070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:09.896757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 775/1541] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:09.901653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:09.912603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37093-6897-46b7-8911-99c29d59162b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:09.918865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:09.919866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.920416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.920922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.921888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:09.922513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:09.928188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:09.941965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 767/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:09.951402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:09.965186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d959ea-e956-43a0-8236-0c1eadd59694 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:09.972128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:09.972823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.973102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.973372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.974082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:09.976130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cfd61-32a2-40b3-a95e-09c96f1e6374 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.026655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 776/1543] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:09 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:10.031640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.048256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fc8e-a4ea-4eb4-ad9b-5fa0e2330845 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.133196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.133894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.134181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.134459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.135181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.137235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.166513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 768/1544] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:10.169649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130462-4bdf-4f59-bbb3-6f3b648a2c1a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.170634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130462-4bdf-4f59-bbb3-6f3b648a2c1a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.170843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.171379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130462-4bdf-4f59-bbb3-6f3b648a2c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.182305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f5f8-7b1f-4eed-9a13-8c2cebfd71db admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.191178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.191911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.192199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.192479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.193230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.195073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.212087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 769/1545] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:39:10.213403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.214264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2d130462-4bdf-4f59-bbb3-6f3b648a2c1a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.215816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2d130462-4bdf-4f59-bbb3-6f3b648a2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.235863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647ade-0b13-4f0b-8c8a-45cd1fe93ee5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.246679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.247400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.247684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.247989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.248727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.249679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 777/1546] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.254266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.271026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 770/1547] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:10.273258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608bf7-c472-48ac-8cec-3baf57e41f4a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.273764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608bf7-c472-48ac-8cec-3baf57e41f4a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.274221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608bf7-c472-48ac-8cec-3baf57e41f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.286406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.293709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a409f6-6878-48bc-9d98-a780c8e757f5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.305542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.306481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.306763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.307060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] PATH_INFO: `/v3/projects/9298bf4635e84993b086309715cc7cbe/users/007ce9b8109343e0914efe94c6aa6a89/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.324839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0b608bf7-c472-48ac-8cec-3baf57e41f4a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.326579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0b608bf7-c472-48ac-8cec-3baf57e41f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.332178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9298bf4635e84993b086309715cc7cbe, user_id=007ce9b8109343e0914efe94c6aa6a89, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.333277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:10.333277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:39:10.333277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:39:10.335228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e8741-0ddf-409c-b6b2-b0c4b9a24e1c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.355110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 778/1548] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.358199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.358521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.358854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.362916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 771/1549] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:10 2022] PUT /identity/v3/projects/9298bf4635e84993b086309715cc7cbe/users/007ce9b8109343e0914efe94c6aa6a89/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:10.365251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c200-945a-4bcf-9f96-24c773ec4191 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.365690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c200-945a-4bcf-9f96-24c773ec4191 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.365967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c200-945a-4bcf-9f96-24c773ec4191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.385021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.386250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.386391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-caf1c200-945a-4bcf-9f96-24c773ec4191 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.387632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-caf1c200-945a-4bcf-9f96-24c773ec4191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.460767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 772/1550] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.462443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79bb6-2819-4290-a723-aa073096536a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.462673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 779/1551] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.463025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79bb6-2819-4290-a723-aa073096536a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.463310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79bb6-2819-4290-a723-aa073096536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.463551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.475890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12564-9f8b-48fb-9c28-d46287dd1158 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.480988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.481648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.481927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.482197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.482962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.483262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.483395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a0c79bb6-2819-4290-a723-aa073096536a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.484322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:10.484322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:39:10.484322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:39:10.484589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0c79bb6-2819-4290-a723-aa073096536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.485202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174d62c-8dab-4172-8453-d691725c7362 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.493819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 773/1552] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.495258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc45b6c-a5f1-4be4-932f-7dfadf166b77 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.495586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc45b6c-a5f1-4be4-932f-7dfadf166b77 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.495858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc45b6c-a5f1-4be4-932f-7dfadf166b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.497716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 780/1553] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.499063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3008-50c2-4fc8-94a9-cbb347e48f7f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.499428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3008-50c2-4fc8-94a9-cbb347e48f7f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.499644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3008-50c2-4fc8-94a9-cbb347e48f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.517358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3d5b3008-50c2-4fc8-94a9-cbb347e48f7f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.517650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7fc45b6c-a5f1-4be4-932f-7dfadf166b77 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.518557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3d5b3008-50c2-4fc8-94a9-cbb347e48f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.518863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7fc45b6c-a5f1-4be4-932f-7dfadf166b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.526038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 781/1554] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.527235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275989c-45b6-449e-865b-7a45e4782167 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.527548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275989c-45b6-449e-865b-7a45e4782167 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.527823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275989c-45b6-449e-865b-7a45e4782167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.527976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 774/1555] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.529162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a645-9e75-4475-90e2-6462d8ef18c8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.529559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a645-9e75-4475-90e2-6462d8ef18c8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.530344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09a645-9e75-4475-90e2-6462d8ef18c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.552174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7275989c-45b6-449e-865b-7a45e4782167 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.552420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bd09a645-9e75-4475-90e2-6462d8ef18c8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.553387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7275989c-45b6-449e-865b-7a45e4782167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.553497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd09a645-9e75-4475-90e2-6462d8ef18c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.561210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 782/1556] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.564515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 775/1557] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.564640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.564755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ec8-5108-48a8-81ca-7d271e389d4f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.564846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.564936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ec8-5108-48a8-81ca-7d271e389d4f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.565033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.565136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ec8-5108-48a8-81ca-7d271e389d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.577003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:10.585801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.587380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.589469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f3b70ec8-5108-48a8-81ca-7d271e389d4f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.590671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f3b70ec8-5108-48a8-81ca-7d271e389d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.595117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 783/1558] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.595911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.601268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 776/1559] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.602568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.602860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.603142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.608068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd12f-9097-4b7c-9eff-58e1fc76ac78 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.612541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.613126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.613403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.613673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.614351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.616374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e330b3-c83e-4b79-a088-e77143cbf306 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.621698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.622920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.630881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 777/1560] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.631721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.633154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.645159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 784/1561] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:10.646533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76258-1491-4b19-b18d-8ce4790fdf58 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.646824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76258-1491-4b19-b18d-8ce4790fdf58 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.647100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76258-1491-4b19-b18d-8ce4790fdf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.664282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-65a76258-1491-4b19-b18d-8ce4790fdf58 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.665458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-65a76258-1491-4b19-b18d-8ce4790fdf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.689775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0da8-b5c6-46d0-b75f-47f5a081c137 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.724425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 785/1562] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.725719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894f6b-d038-4f43-abf7-addf00c93f11 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.726003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894f6b-d038-4f43-abf7-addf00c93f11 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.726277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894f6b-d038-4f43-abf7-addf00c93f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.734271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:10.738661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.739327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.739645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.739921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.745720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0c894f6b-d038-4f43-abf7-addf00c93f11 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.746937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0c894f6b-d038-4f43-abf7-addf00c93f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.749581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.751033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.755032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 786/1563] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.759835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.760125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.760403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.761391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 778/1564] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:10.762266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.771457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091babe8-eecd-4c92-b6d2-e9095496eace service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.778183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.778844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.779132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.779484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.779625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:10.780217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.780756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.780889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:10.782153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.789938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 787/1565] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:10.790764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.804878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 779/1566] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.804878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.808099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884715-8f55-4ee8-b008-83187967eba5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.811743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b79d-d614-4d6e-968e-495873b4f857 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.813169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.813838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.814122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.814399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.815142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.815469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.817087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.818785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.819835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.820192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.820546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.821345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.822067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.823525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.829750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 788/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.830608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.839047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 780/1568] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.841403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df6df-5487-4c9f-9c72-9f073d60b440 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.844298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.849846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.850707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.851077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.851643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.852531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.853698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:10.853698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:39:10.853698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:39:10.855073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef0942-e00e-44e4-ad21-b1f6ee97214f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.855659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.860601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.861266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.861573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.861832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.862735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.862995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.864721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.877587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 781/1569] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.878144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.890932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1a2-52cb-4d7f-a969-74a50cf6ff30 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.891630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 789/1570] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:10.892510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.895945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.896690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.896961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.897282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.898015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.898324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.900011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.905372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a87d6-f129-4546-9c60-226da15baeba admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.912452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.913107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 782/1571] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.913237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.913643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.914001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.915047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:10.916743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.917409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.921142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.932330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 790/1572] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:10.933001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:10.936791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a9641-eba2-4885-903e-4ada659fb0e4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.946672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.947432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.947739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.948008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.948835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.949922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:10.949922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:39:10.949922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:39:10.950349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c0e0-d799-43da-ade8-367816ff4766 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:10.951536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.955199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:10.956466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:10.956867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:10.957155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:10.957871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:10.959890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:10.987202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 783/1573] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:10.987202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.005464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 791/1574] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.005464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.037097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:11.064907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ce20-d28a-49fb-86c9-8e7efa15964b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.069892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.070585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.070841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.071111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.071867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.073902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.074415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fd9e9-5720-4143-808d-e6c45c1d479f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.080001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.080682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.081017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.081299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.082005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.084152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.114186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 784/1575] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:10 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.115800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.125238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 792/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.125238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.189382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73635d9e-ee8e-4820-aec9-67cb97085105 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.194407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.195151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.195473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.195784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.196525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.198203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.198597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbda41-2a16-4d60-a3d9-26e105b4e332 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.203735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.204481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.204760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.205032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.205739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.207669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.209182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 785/1577] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.209997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.220799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4340-555c-4a12-9116-b06f2a3c1616 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.226317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.226666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.226951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.227232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.228102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.237183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:11.239696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.254909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 793/1578] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.256441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.280492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 786/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.281579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.340938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ebaa-0c54-44a7-bb67-166cb15dfbbb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.367443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9088191-fbfb-4a2c-9e27-cfd0f40d9cf3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.372333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.373093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.373377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.373653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.374348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.376346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.399826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 787/1580] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.400664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.408106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.408792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.409093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.409338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.410111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.412212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.412678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab5f4-34be-45c0-bf8b-f384274b1024 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.417301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.418056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.418399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.418738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.419656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.422293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.436508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 794/1581] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.437371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.448005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 788/1582] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.450968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add227d8-ce29-4bde-8af6-7616a9030524 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.451139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.452973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.453648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.453926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.454330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.455019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.457139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.459765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e357-7376-4352-a919-2f040a77a1e1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.465368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.466049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.466626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.466626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.467827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.469244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.471564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:11.482323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 795/1583] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.483074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.488154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 789/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.489967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.493318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e0d3-4148-47b0-a556-7d104f3cb881 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.498669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.499377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.499667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.499935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.500641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.500751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbed98-66a9-430e-9ed6-d78a4015de4f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.502551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.505742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.506758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.506758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.507059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.507741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.510058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.528433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 796/1585] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 281 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.529226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.540495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf4eb-507f-4c3d-8359-5c1e47524adc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.546395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.547078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.547412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.547654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.547872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 790/1586] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:11.548410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.548900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.550149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.562563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b7ad-598c-494d-9a36-97d72b6f9c48 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.568289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 797/1587] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.568289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.571775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.572478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.573512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.573512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.573822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.575568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.580428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b2d1-ef06-484f-baf8-417282727f18 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.587952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 791/1588] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.590001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.591035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.591035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.591739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.592113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.592636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.594347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.604386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd06c-6809-47c3-b287-a90d482e1676 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.611702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 798/1589] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.612607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.624959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcc947-c44c-4d90-9e36-92755d50e600 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.628760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.629443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.629727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.630133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.631174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.632708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.637326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.638275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.638718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.639039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] PATH_INFO: `/v3/projects/fea0a1a7e2574c5a8ddc9ff93749c022/users/944d72f95b2a41309feccfc1b6fe8df6/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.653944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 792/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.656793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.659566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea0a1a7e2574c5a8ddc9ff93749c022, user_id=944d72f95b2a41309feccfc1b6fe8df6, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.662806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.674102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064467b-9014-4090-83dc-182eef2147ea admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.693176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 799/1591] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:11 2022] PUT /identity/v3/projects/fea0a1a7e2574c5a8ddc9ff93749c022/users/944d72f95b2a41309feccfc1b6fe8df6/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:11.694574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.711082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:11.752716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.754596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.754948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.755289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.756295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.758197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.770710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 793/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.773743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136d8c-6ae7-42c8-b81a-270d661f348c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.773833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.776471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.777163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.777441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.777716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.778610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.780558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.784738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf95d-3561-4c02-ae8e-4795bae17c2b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.789965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.791070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.791485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.791816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.791926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 800/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.792852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.793025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.795490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.813958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5fb0a-bcce-4ae9-8842-c64c03bd9dd8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.817426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 794/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.818475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.818920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.819802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.820150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.820351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.821213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.822931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.833771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea2fb-186d-45cd-b849-cec76c2f6377 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.834664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 801/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.835970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.842529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.843849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.844142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.844421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.845165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.847300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c2aae-f35c-4bc0-b537-c1dc24de8617 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.847712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986b92-2f80-41a1-967d-14a7eec63786 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.853223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.854096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.854829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.855114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.855965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.857671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.859717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 795/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.863141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.863141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.863141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.872339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 802/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.873128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.883667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8f9e-edd8-483a-8649-9ce538b84387 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.889392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.890068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.890346 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.890619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.891359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.892995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.898945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] MFA Rules not processed for user `944d72f95b2a41309feccfc1b6fe8df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:11.900826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:11.905566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 803/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.906697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.919187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec994f01-0529-45df-b291-e24fe6298b9d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.926569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.927248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.927641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.928086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.928822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.931151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:11.946702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 804/1599] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:11.946702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.959327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393eb607-6cce-4e06-92d7-206deab0939f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:11.967988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:11.968926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:11.969207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:11.969481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] PATH_INFO: `/v3/projects/fc032917ef6c425cb7e8947d5ad218bf/users/89b5b894f647493aa2db2b478d7925a0/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:11.990245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc032917ef6c425cb7e8947d5ad218bf, user_id=89b5b894f647493aa2db2b478d7925a0, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:11.990826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 796/1600] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:11.991894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:11.994553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.007456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2125-9d6a-4798-9728-1a1302aeb76c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.021030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 805/1601] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:11 2022] PUT /identity/v3/projects/fc032917ef6c425cb7e8947d5ad218bf/users/89b5b894f647493aa2db2b478d7925a0/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.021030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.034847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.115859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.116866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.117227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.117353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0393-a752-4603-add1-06ec2823cf77 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.117655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] PATH_INFO: `/v3/projects/855cb6e79485414ab0f2a40162231d72/users/ae510389cfc04a0cb4e6991df2a93a00/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.122631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.123775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.124118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.124685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] PATH_INFO: `/v3/projects/1d89deaaefc541739f67ab1e53c4bda3/users/b191f41e53064acbaf17e3da073e7c85/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.135889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855cb6e79485414ab0f2a40162231d72, user_id=ae510389cfc04a0cb4e6991df2a93a00, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.138920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.143181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d89deaaefc541739f67ab1e53c4bda3, user_id=b191f41e53064acbaf17e3da073e7c85, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.146381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.161035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 797/1602] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:11 2022] PUT /identity/v3/projects/855cb6e79485414ab0f2a40162231d72/users/ae510389cfc04a0cb4e6991df2a93a00/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.164343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.172281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 806/1603] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:12 2022] PUT /identity/v3/projects/1d89deaaefc541739f67ab1e53c4bda3/users/b191f41e53064acbaf17e3da073e7c85/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.172281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.225728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.282769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaef9b-be85-47e3-97a6-f5c2fb9b0ee9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.285409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4977-a650-45ee-9393-1d81da16ca12 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.289033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.290505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.291419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.291736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] PATH_INFO: `/v3/projects/83deb4e68e0742afb3144d0d13909f2a/users/d410d46bde014275a0da489a2c37ac8c/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.293912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.295705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.296178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.296758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] PATH_INFO: `/v3/projects/718435e938554bba812eee4a8bdc3c69/users/04c3653b3c5446e39e09338c64f5cdc3/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.315325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83deb4e68e0742afb3144d0d13909f2a, user_id=d410d46bde014275a0da489a2c37ac8c, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.320276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.321217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=718435e938554bba812eee4a8bdc3c69, user_id=04c3653b3c5446e39e09338c64f5cdc3, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.324960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807405e-e837-48dc-957c-590f1e056d4c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.346000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 798/1604] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:12 2022] PUT /identity/v3/projects/83deb4e68e0742afb3144d0d13909f2a/users/d410d46bde014275a0da489a2c37ac8c/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.346601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 807/1605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:12 2022] PUT /identity/v3/projects/718435e938554bba812eee4a8bdc3c69/users/04c3653b3c5446e39e09338c64f5cdc3/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.347641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.348304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10e14-c915-4207-82fc-0c7bc364e3d9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.348648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10e14-c915-4207-82fc-0c7bc364e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.349020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10e14-c915-4207-82fc-0c7bc364e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.384158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-72d10e14-c915-4207-82fc-0c7bc364e3d9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.386273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72d10e14-c915-4207-82fc-0c7bc364e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.456282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5315-bd9d-44c7-8d25-06b0bc8cd44f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.470574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 808/1606] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.472153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c048ed-cc08-4908-a7b8-11f31b6f1e78 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.472442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c048ed-cc08-4908-a7b8-11f31b6f1e78 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.472719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c048ed-cc08-4908-a7b8-11f31b6f1e78 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.481863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 809/1607] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 23 13:39:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:12.483455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd7d6-7092-4f23-b924-2afc657acc2d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.483749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd7d6-7092-4f23-b924-2afc657acc2d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.484027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd7d6-7092-4f23-b924-2afc657acc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.507370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.518847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2f4dd7d6-7092-4f23-b924-2afc657acc2d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.520959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2f4dd7d6-7092-4f23-b924-2afc657acc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.537947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 810/1608] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.539763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53985b-2029-458a-87e2-7ed1ea48d100 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.540049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53985b-2029-458a-87e2-7ed1ea48d100 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.540363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53985b-2029-458a-87e2-7ed1ea48d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.558997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.560158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.561121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.561519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] PATH_INFO: `/v3/projects/8e4aa13d65ad43b1849bad5bfa99e459/users/d503b205ca214601a119535611899e95/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.568440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3d53985b-2029-458a-87e2-7ed1ea48d100 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.570299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3d53985b-2029-458a-87e2-7ed1ea48d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.580873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 811/1609] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.583190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.587322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4aa13d65ad43b1849bad5bfa99e459, user_id=d503b205ca214601a119535611899e95, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.591266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cdf57-c0f0-42a9-853c-5de5df01d68d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.591511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.591870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.613449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 799/1610] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:12 2022] PUT /identity/v3/projects/8e4aa13d65ad43b1849bad5bfa99e459/users/d503b205ca214601a119535611899e95/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:12.614940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7b57-6ae4-4049-bf71-5afcc8d2d6b9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.615235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7b57-6ae4-4049-bf71-5afcc8d2d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.615590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7b57-6ae4-4049-bf71-5afcc8d2d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.628557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] MFA Rules not processed for user `04c3653b3c5446e39e09338c64f5cdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.630027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.650166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e91a7b57-6ae4-4049-bf71-5afcc8d2d6b9 None None] MFA Rules not processed for user `d410d46bde014275a0da489a2c37ac8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.651452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e91a7b57-6ae4-4049-bf71-5afcc8d2d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.759554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 812/1611] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.761044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.780371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 800/1612] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.781997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.785186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.785505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.800862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.836147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.837825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.838242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86782a21-cb49-4b9e-885d-5c69407d0d96 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.842514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.843325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.843899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.844372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.912333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.913797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.920182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 801/1613] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.925123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 813/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:12.926172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.933830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.936270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7932f-715c-4574-af73-f2f6219ebfc9 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.940080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.940732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.941020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.941288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.946887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514f4a8-94b3-4ac9-858a-698dee9a8b02 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:12.952308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.953798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b852-ed33-46fa-a5d8-91a0a568d175 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.955155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:12.957112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.957400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.957798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.967286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 814/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:12.969759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686221e-fdba-45e9-b744-f75fc11efbd7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.970053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686221e-fdba-45e9-b744-f75fc11efbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.971071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686221e-fdba-45e9-b744-f75fc11efbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.972293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:12.974285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:12.991069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 802/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:12.991967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:12.992772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b686221e-fdba-45e9-b744-f75fc11efbd7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.994160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b686221e-fdba-45e9-b744-f75fc11efbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:13.004225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 815/1617] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:13.005676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d18a3-1008-4c04-ac56-8644cb7e4c71 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.005965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d18a3-1008-4c04-ac56-8644cb7e4c71 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.006243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d18a3-1008-4c04-ac56-8644cb7e4c71 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.007976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 816/1618] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 23 13:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:13.008701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d18a3-1008-4c04-ac56-8644cb7e4c71 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.015659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519dce9-8642-410a-9fb0-c5a21d34ae45 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.021579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.022273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.022560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.022840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.024544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.026705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3224ac-1d4f-4e53-9caa-92728bac34f8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.033374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d18a3-1008-4c04-ac56-8644cb7e4c71 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.042924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.043692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.044207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.044501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.071609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 803/1619] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:13.079495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.080513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.081265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.091052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:13.118612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:13.120453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:13.192405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.199449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.219706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 817/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:13.222166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.249193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ed4e8-bf2c-4a07-8b68-c3600a1f8fe0 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.264096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 804/1621] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 23 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:13.270092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.391998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.393102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.393639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.394270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.399561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:13.429248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3f474-ffe6-466a-8bf8-cdc501a47a97 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.448585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.449296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.449581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.449858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.450583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.458717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.528515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 805/1622] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:13 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:13.531503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.540449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.542176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.563709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7b4c-a759-4332-80ab-77e16d4ccb55 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.570346 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 818/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:13.572200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.572839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.584160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.585168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.585951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.612073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6d7f-e289-4800-83b9-1b12df99ec1d service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.629189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.630158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.631887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.632336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.634706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.639495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.669955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 819/1624] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:13.671230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.701943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba303-66dc-4b19-93bf-1ae483a949ff admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.730533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.731438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.732882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.733392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.733978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] PATH_INFO: `/v3/projects/524945b4bf8c4f90a358e458b9a080e0/users/da14b7e24ca94452807055afce433a8e/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.735686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.759207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524945b4bf8c4f90a358e458b9a080e0, user_id=da14b7e24ca94452807055afce433a8e, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.763170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7952ab-41d6-4393-83b0-98fb62e99eb8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.766987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 806/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:13.806922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 820/1626] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:13 2022] PUT /identity/v3/projects/524945b4bf8c4f90a358e458b9a080e0/users/da14b7e24ca94452807055afce433a8e/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:13.810705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.825184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad22a-3d13-497f-9842-13b7948bbd1b service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.867988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf654-7d9d-48d9-bba6-e58eb5d83736 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.868280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf654-7d9d-48d9-bba6-e58eb5d83736 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.868808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf654-7d9d-48d9-bba6-e58eb5d83736 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.874425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 821/1627] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 23 13:39:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:13.886359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:13.892111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.892394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.892826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.948399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:13.954605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:13.984879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.986907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.987317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.988602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.989500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.995894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:14.028795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 807/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:14.030595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:14.052408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860afdce-281f-492f-bed7-f92a38d74f3f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:14.065492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:14.066780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.068009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.069164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] PATH_INFO: `/v3/projects/524945b4bf8c4f90a358e458b9a080e0/users/da14b7e24ca94452807055afce433a8e/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.076736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=524945b4bf8c4f90a358e458b9a080e0, user_id=da14b7e24ca94452807055afce433a8e, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:14.079795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d2511-4d9a-4119-b4d4-61ff9b33bd5b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:14.110016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 808/1629] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:14 2022] PUT /identity/v3/projects/524945b4bf8c4f90a358e458b9a080e0/users/da14b7e24ca94452807055afce433a8e/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:14.121134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.121572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.121963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.168059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 822/1630] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:14.182833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:14.195966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] MFA Rules not processed for user `da14b7e24ca94452807055afce433a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:14.197462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:14.308062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67091b6b-5d19-4d45-86ca-8dc6c9e756a3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:14.328286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:14.373672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 809/1631] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:14.387202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:14.424478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:14.427850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.427850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.427850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.455212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67608d-ae5f-4c95-8f79-8e3a82cc5de4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:14.458516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:14.459317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.459635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.459916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.474031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:14.475535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7b85-9b51-4b6e-85ee-25a05167772b service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:14.504248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 810/1632] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:14.562394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e6ec-9b32-413b-8da7-bfbfa8ed3ee9 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.562692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e6ec-9b32-413b-8da7-bfbfa8ed3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.562998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e6ec-9b32-413b-8da7-bfbfa8ed3ee9 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.565375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 811/1633] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 23 13:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:39:14.575103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255319-5242-496a-9536-39f4919d6535 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.575752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255319-5242-496a-9536-39f4919d6535 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.576111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255319-5242-496a-9536-39f4919d6535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.609757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-90255319-5242-496a-9536-39f4919d6535 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:14.611028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-90255319-5242-496a-9536-39f4919d6535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:14.669333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:14.671246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:14.703224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 823/1634] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:14.742312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:14.821152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 812/1635] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:14.923463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:14.937498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25ee0-6ee8-400f-9740-47d162f760ce service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:14.942090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:14.942781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:14.943064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:14.943359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:14.975777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:14.980101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:15.012225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 824/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:15.521255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255319-5242-496a-9536-39f4919d6535 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:15.704312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255319-5242-496a-9536-39f4919d6535 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:15.716851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:15.718076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:15.718076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:15.718321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] PATH_INFO: `/v3/users/d410d46bde014275a0da489a2c37ac8c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:15.719871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d410d46bde014275a0da489a2c37ac8c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:15.720907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: WARNING py.warnings [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:15.720907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: warnings.warn(msg) Jun 23 13:39:15.720907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: Jun 23 13:39:15.722512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:15.820214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:15.844801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21010913-c609-44e1-a894-4cdd5f56314e service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:15.851941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd410d46bde014275a0da489a2c37ac8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:15.879230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:15.880176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:15.880461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:15.880742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] PATH_INFO: `/v3/users/04c3653b3c5446e39e09338c64f5cdc3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:15.882519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c3653b3c5446e39e09338c64f5cdc3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:15.884491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:15.884889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd410d46bde014275a0da489a2c37ac8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:15.909582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd410d46bde014275a0da489a2c37ac8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:15.910422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd410d46bde014275a0da489a2c37ac8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:15.987073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03dd1368-ea78-4341-bc73-b30bf8511526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd410d46bde014275a0da489a2c37ac8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.003627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 813/1637] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:15 2022] DELETE /identity/v3/users/d410d46bde014275a0da489a2c37ac8c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:16.004742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c3653b3c5446e39e09338c64f5cdc3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.008154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:16.008666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:16.009070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:16.017867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c3653b3c5446e39e09338c64f5cdc3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.018816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c3653b3c5446e39e09338c64f5cdc3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.037725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c3653b3c5446e39e09338c64f5cdc3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.038596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38792780-3bde-4141-a8d9-4e8d90946725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c3653b3c5446e39e09338c64f5cdc3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:16.045940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:16.047715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:16.079001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 825/1638] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:15 2022] DELETE /identity/v3/users/04c3653b3c5446e39e09338c64f5cdc3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:16.084141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:16.084431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:16.084710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:16.130770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:16.139413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:16.140659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:16.154998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:16.188655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 814/1639] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:16.204289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:16.206286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:16.282321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 826/1640] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:16.299612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:16.301971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:16.325547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60cb32-731b-4663-9e72-bf0a582d14ac None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:16.413972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e581-c4d3-40a8-b356-04935fdc14ab None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:16.420042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:16.420811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:16.427194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:16.427716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:16.435467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:16.436446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:16.436803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:16.437301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:16.450570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:16.451381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:16.452768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:16.452981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:16.468747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 815/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:16.476210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 827/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:18.073924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.078093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.104889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73128-ae3e-48e2-a632-3dcfef939cdb service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.113083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.114858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.116068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.116571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] PATH_INFO: `/v3/projects/718435e938554bba812eee4a8bdc3c69` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.130227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718435e938554bba812eee4a8bdc3c69)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.133685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.226075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718435e938554bba812eee4a8bdc3c69', 'request_id': 'req-9ac1705c-9812-4862-8a30-994c4d20fd69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.239069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718435e938554bba812eee4a8bdc3c69', 'request_id': 'req-9ac1705c-9812-4862-8a30-994c4d20fd69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.250538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718435e938554bba812eee4a8bdc3c69', 'request_id': 'req-9ac1705c-9812-4862-8a30-994c4d20fd69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.266091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] The token cache is being invalidate because project 718435e938554bba812eee4a8bdc3c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:18.266387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.267127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9ac1705c-9812-4862-8a30-994c4d20fd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.282621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 816/1643] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:18 2022] DELETE /identity/v3/projects/718435e938554bba812eee4a8bdc3c69 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:18.283764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.284490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.284783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.285506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.299920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10fe2-3b5e-4a6c-84ec-4cf1ddfdf5f1 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.318158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] MFA Rules not processed for user `89b5b894f647493aa2db2b478d7925a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:18.319586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.334763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:18.416714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.417849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.418265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.418673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] PATH_INFO: `/v3/users/da14b7e24ca94452807055afce433a8e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.420387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=da14b7e24ca94452807055afce433a8e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.422584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.441959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 817/1644] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:18.447391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.449165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.472685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99158-900d-4925-9910-800523cd9ca5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.478986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.480023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.480467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.480875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.481814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.484334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.501595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da14b7e24ca94452807055afce433a8e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.514445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da14b7e24ca94452807055afce433a8e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.515618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da14b7e24ca94452807055afce433a8e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.520440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:18.522493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 818/1645] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:18 2022] POST /identity/v3/projects => generated 403 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:39:18.526556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.538268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da14b7e24ca94452807055afce433a8e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.539081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da14b7e24ca94452807055afce433a8e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.574301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 828/1646] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:18 2022] DELETE /identity/v3/users/da14b7e24ca94452807055afce433a8e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:18.574301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.574816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.650327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0bb53-a85f-49e6-b6d3-ca9942fef375 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.699598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d01271-1441-4dd7-9b05-1d4cdf9ea2ac admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.704880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.705854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.706195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.706549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] PATH_INFO: `/v3/projects/83deb4e68e0742afb3144d0d13909f2a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.707981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83deb4e68e0742afb3144d0d13909f2a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.709236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: WARNING py.warnings [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:39:18.709236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: warnings.warn(msg) Jun 23 13:39:18.709236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: Jun 23 13:39:18.710508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.750484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.751285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.751826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.752272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.753527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.755523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.783234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 819/1647] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:18 2022] POST /identity/v3/users => generated 308 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:39:18.787402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.792052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.821770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289b3f-2365-4d52-a327-abdec82719cb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.825388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83deb4e68e0742afb3144d0d13909f2a', 'request_id': 'req-f2c78587-6954-4c81-be87-a214611ca770'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.833261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83deb4e68e0742afb3144d0d13909f2a', 'request_id': 'req-f2c78587-6954-4c81-be87-a214611ca770'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.855226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83deb4e68e0742afb3144d0d13909f2a', 'request_id': 'req-f2c78587-6954-4c81-be87-a214611ca770'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.871226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:18.881340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] The token cache is being invalidate because project 83deb4e68e0742afb3144d0d13909f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:18.882177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.882999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f2c78587-6954-4c81-be87-a214611ca770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:18.890208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 829/1648] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:18 2022] DELETE /identity/v3/projects/83deb4e68e0742afb3144d0d13909f2a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:18.892164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257441-3640-4941-9ec1-14317638f415 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.892369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257441-3640-4941-9ec1-14317638f415 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.892650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257441-3640-4941-9ec1-14317638f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.929411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-36257441-3640-4941-9ec1-14317638f415 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:18.932394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-36257441-3640-4941-9ec1-14317638f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.936547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.938648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.939174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.943475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.944400 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.944596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 830/1649] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:18.947186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.953554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.953851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.954126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.971166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 820/1650] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:18.972251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.974091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.987650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:18.989363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.989947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e8ae5-324c-4989-a6fd-0cd2bd44e1b0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.995411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.996337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.996618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.996891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] PATH_INFO: `/v3/projects/411d2c83d607408284b3bad502b22ca8/users/3b309af717a6492eb0767f00407538f0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.010653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 831/1651] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:19.012511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.018003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411d2c83d607408284b3bad502b22ca8, user_id=3b309af717a6492eb0767f00407538f0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.022807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.036679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1c4d-ddbb-47dc-94d3-5fd86ee27519 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.048763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 821/1652] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:18 2022] PUT /identity/v3/projects/411d2c83d607408284b3bad502b22ca8/users/3b309af717a6492eb0767f00407538f0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:19.052845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.053756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.056135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.056815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.058865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.059801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:19.060121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.066752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.092754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 832/1653] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:19.097613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.113176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d3b51-76bc-480d-b036-c87f7a3babc2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.177338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:19.216465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.217631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.218100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.219809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.221360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.225782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.275837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0631-8de7-4c22-93ba-197038ec3037 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.278343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 833/1654] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:19 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:19.279963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.374509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7c5f4-d3d2-491d-84bf-3a9f58fc8275 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.381455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.382157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.382508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.382942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.383830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.386654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.401415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.405058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.405561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.405945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.407016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.409323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.442761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 834/1655] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:19 2022] POST /identity/v3/users => generated 279 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:19.447912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.452066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 822/1656] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:19.453249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.474078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7863-8c14-4159-b22c-712be0a33028 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.474599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48732d7-6655-4299-8abd-85ee10f4bebb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.480142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.481317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.482015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.482230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.482326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.482570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.482772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.483152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] PATH_INFO: `/v3/projects/411d2c83d607408284b3bad502b22ca8/users/3b309af717a6492eb0767f00407538f0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.483435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.485695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411d2c83d607408284b3bad502b22ca8, user_id=3b309af717a6492eb0767f00407538f0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.486514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.488632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.507700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 823/1658] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:19 2022] PUT /identity/v3/projects/411d2c83d607408284b3bad502b22ca8/users/3b309af717a6492eb0767f00407538f0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:19.507864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 835/1658] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:19.509496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.559651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:19.632524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d7ca-e21c-43ca-86c7-89ee98f27892 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.642445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.643847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.644303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.644750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.646170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.648707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539190-81d4-4b6f-865e-d365089e8ce9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.677908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 824/1659] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:19.679606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:19.696379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1eab-ba2d-4839-acf0-8ba732624f5e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:19.705047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:19.706387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.706931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.707448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] PATH_INFO: `/v3/projects/c1b51b7825474d18b81600c911fdd45f/users/fe9006a01b40434e9a47c02eb207826d/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.748870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b51b7825474d18b81600c911fdd45f, user_id=fe9006a01b40434e9a47c02eb207826d, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:19.753247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f1300-df66-4b6a-8d32-92459d9b5fcd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:19.795250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.795504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.796167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:19.801184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 836/1660] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:19 2022] PUT /identity/v3/projects/c1b51b7825474d18b81600c911fdd45f/users/fe9006a01b40434e9a47c02eb207826d/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:19.861218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] MFA Rules not processed for user `fe9006a01b40434e9a47c02eb207826d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:19.862496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:19.975948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:19.976259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:19.977813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.029245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 825/1661] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:20.033451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.045898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] MFA Rules not processed for user `007ce9b8109343e0914efe94c6aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:20.053558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:20.200875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fd8df-2beb-4bc8-8a7a-772d8eeedfe4 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.217413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.218124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.218406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.218922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.219782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.221768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.240432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 837/1662] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:20.263868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.265298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:20.299960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:20.328685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 826/1663] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:20 2022] POST /identity/v3/projects => generated 357 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:39:20.330648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.444720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:20.469235 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b15ef-043a-4764-a040-8a7672fa4224 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.508721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598da0-c03e-4487-8e7c-955aec0032df admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.527308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.541571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.545829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.546105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.549827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.561373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.628176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.628870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.629150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.630017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 827/1664] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:20 2022] POST /identity/v3/users => generated 285 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:20.630270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.634090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.689154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1017a3-a973-4069-b53c-e87433b9976a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.705619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.706565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.707145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.707782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.712727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.714647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.749996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 828/1665] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:20.752960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.775047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7bf6-bf5e-4444-b057-62ecc7c672a4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.788988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.791038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.791350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.792853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] PATH_INFO: `/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51/users/0bde89b00c1e4ba59c8c79e80bf789fb/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.801530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.805552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.832338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 838/1666] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:20.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e2021dd865437593cd8e0c8ce1ec51, user_id=0bde89b00c1e4ba59c8c79e80bf789fb, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.836794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.838061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.839985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:20.868883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 829/1667] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:20 2022] PUT /identity/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51/users/0bde89b00c1e4ba59c8c79e80bf789fb/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:20.871895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e60f1-ece1-4774-a9a9-685a5f258b6a service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.872988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.940403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:20.961269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.973063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.977316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.977865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] PATH_INFO: `/v3/projects/524945b4bf8c4f90a358e458b9a080e0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.979679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524945b4bf8c4f90a358e458b9a080e0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.981963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.065352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104ac17-3933-4072-8e82-f7c3c355e433 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.083639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.084298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.084608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.084852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.085589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.087878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.123394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 830/1668] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:21.125174 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.130163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524945b4bf8c4f90a358e458b9a080e0', 'request_id': 'req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:21.145499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524945b4bf8c4f90a358e458b9a080e0', 'request_id': 'req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:21.158479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524945b4bf8c4f90a358e458b9a080e0', 'request_id': 'req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:21.183462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] The token cache is being invalidate because project 524945b4bf8c4f90a358e458b9a080e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:21.183753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:21.184552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8fb3e97a-e8e5-43d2-9f5b-1a1b6af83f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:21.184746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36aa1-a2ec-4d84-88e4-3a3fc1cb8102 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.186599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 839/1669] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:20 2022] DELETE /identity/v3/projects/524945b4bf8c4f90a358e458b9a080e0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:21.191365 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b441-26c8-4443-a733-92336850a204 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.191682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b441-26c8-4443-a733-92336850a204 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.191965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b441-26c8-4443-a733-92336850a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.242590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5bb6b441-26c8-4443-a733-92336850a204 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:21.243872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5bb6b441-26c8-4443-a733-92336850a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:21.348484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.349274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.349565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.349846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] PATH_INFO: `/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51/users/0bde89b00c1e4ba59c8c79e80bf789fb/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.351911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e2021dd865437593cd8e0c8ce1ec51, user_id=0bde89b00c1e4ba59c8c79e80bf789fb, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.354610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb61a8f-9540-45f3-9971-edc0de9cfb45 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.356371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 840/1670] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:21.364103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.364418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.364669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.390518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 831/1671] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:21 2022] PUT /identity/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51/users/0bde89b00c1e4ba59c8c79e80bf789fb/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:21.391879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.392324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.392807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.408261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:21.416128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:21.482499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] MFA Rules not processed for user `0bde89b00c1e4ba59c8c79e80bf789fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:21.483926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:21.518294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:21.539537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 841/1672] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:21.545317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.557514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8dc5-9d34-46bc-9039-ddaf27018c9f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.568895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.570090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.570565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.571070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.572696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:21.573323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.576970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.613103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 842/1673] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:39:21.617910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.632089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:21.634290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 832/1674] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:21.645040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b758c-6e44-4a62-a336-ac44df721eaa admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.652153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.652756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.653279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.654872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.657379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:21.660194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.667736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.672450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.746975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 843/1675] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:21.749452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.776013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343f0f-f4a9-4e3a-95f2-4835a3115264 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.855577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc35d-1db9-4178-8ed3-9904c2a187b4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.861282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.862658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.863108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.863570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.864546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.866963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.904620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 844/1676] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:21.905087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.905841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.906198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.906541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.906704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.920287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e44f-5275-4f43-8fab-7520035bd3ee admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.927976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.928992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.930714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.931203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.932167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.934327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.951430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 845/1677] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:21.952654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.967057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163845f-4cf8-4797-ac86-2f5270d37bc9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.982398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.983430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.983882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.984871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.985952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.987795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:22.032872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 846/1678] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:22.035809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:22.063978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947891-ec65-4585-8239-c799e08e4b08 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:22.081553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:22.083845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.086086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.087435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] PATH_INFO: `/v3/projects/3de305ab79254f019b94bf7eb68d3cca/users/77297a6be4374f1ebc416dc2293b4b3b/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.107815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:22.113391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9f00-66c1-420f-a9d5-dc94b2982bb4 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:22.125452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de305ab79254f019b94bf7eb68d3cca, user_id=77297a6be4374f1ebc416dc2293b4b3b, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:22.132117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:22.141259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 833/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:21 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:22.183305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 847/1680] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:22 2022] PUT /identity/v3/projects/3de305ab79254f019b94bf7eb68d3cca/users/77297a6be4374f1ebc416dc2293b4b3b/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:22.184651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71bc7-0bab-4689-9a01-10cb2b8483bb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.184950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71bc7-0bab-4689-9a01-10cb2b8483bb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.185274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71bc7-0bab-4689-9a01-10cb2b8483bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.296581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6dd71bc7-0bab-4689-9a01-10cb2b8483bb None None] MFA Rules not processed for user `77297a6be4374f1ebc416dc2293b4b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:22.303371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6dd71bc7-0bab-4689-9a01-10cb2b8483bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:22.319429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:22.349077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:22.441257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17edf-a3df-4a73-8f86-268e7358d97b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:22.475218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:22.476266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.477110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.477536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.480066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:22.575289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 834/1681] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:22.576648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.578091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.578607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.656351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:22.660083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] MFA Rules not processed for user `3b309af717a6492eb0767f00407538f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:22.661569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:22.736732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:22.741790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:22.772800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 848/1682] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:22 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:22.773810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:22.842686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 835/1683] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:23.020749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50e37c-34ad-44c6-aab7-48e3dbbe476b service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.041344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.044136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.045398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.045686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.046423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.051160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.134322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 849/1684] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:22 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:23.139446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:23.182550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3104-15a8-4f7e-842d-22b40564b2cc None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.390193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.391602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.391602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.391602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.392121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.403523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.452188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 836/1685] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:23 2022] POST /identity/v3/users => generated 300 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:23.455175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:23.471756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925cf31-8a85-4f7c-b4b1-bfe6871f3c90 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.489496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.490192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.490474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.490746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.491539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.493174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.516447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 850/1686] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:23.519673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:23.534536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14d76-00ec-4f9a-bf28-cc64655dabbc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.547521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.548451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.548738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.549084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] PATH_INFO: `/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978/users/96b555a4d2db4ed0980dee9d95edcad9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.585730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a38b43018849e0a4ea7ec2cacf0978, user_id=96b555a4d2db4ed0980dee9d95edcad9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.589486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.625337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:23.633224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 837/1687] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:23 2022] PUT /identity/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978/users/96b555a4d2db4ed0980dee9d95edcad9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:23.634471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:23.653149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335667-5fbb-4162-bc8c-2b6e883eded5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.774020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.774778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.774979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.775256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.776016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.777637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903bac-2abe-46b1-aaad-ca61a8c7d24d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.801838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 851/1688] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:23.803192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:23.818425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3c3e3-86c6-4975-bba1-4b9254e9508f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:23.824827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:23.826424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.826810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.827094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] PATH_INFO: `/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978/users/96b555a4d2db4ed0980dee9d95edcad9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.830372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a38b43018849e0a4ea7ec2cacf0978, user_id=96b555a4d2db4ed0980dee9d95edcad9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:23.833907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:23.850229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 838/1689] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:23 2022] PUT /identity/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978/users/96b555a4d2db4ed0980dee9d95edcad9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:23.864012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:23.864307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:23.864503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:23.929894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] MFA Rules not processed for user `96b555a4d2db4ed0980dee9d95edcad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:23.932438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.033039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:24.139436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 852/1690] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:24.154634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:24.154634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.161274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:24.163045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.289448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825e9ae-9923-46a4-a947-faeb50e97ecb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:24.299238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:24.300708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.301161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.301632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.320061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30504-c88d-4a08-8b85-80b70d429a66 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:24.324429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:24.326205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:24.334248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:24.335168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.335479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.335754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] PATH_INFO: `/v3/users/944d72f95b2a41309feccfc1b6fe8df6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.337320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944d72f95b2a41309feccfc1b6fe8df6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:24.339420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:24.371127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 853/1691] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:24.395174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:24.428318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b71f-0e46-42a9-ba54-b60de15f2f39 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:24.464306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:24.466356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.467296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.467852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944d72f95b2a41309feccfc1b6fe8df6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.468547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] PATH_INFO: `/v3/users/77297a6be4374f1ebc416dc2293b4b3b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.471069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77297a6be4374f1ebc416dc2293b4b3b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:24.475925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:24.484511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944d72f95b2a41309feccfc1b6fe8df6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.506853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944d72f95b2a41309feccfc1b6fe8df6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.507626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944d72f95b2a41309feccfc1b6fe8df6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.536459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a4a47b7a-c171-417e-afd9-ff46cc201571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944d72f95b2a41309feccfc1b6fe8df6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.551394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 839/1692] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:24 2022] DELETE /identity/v3/users/944d72f95b2a41309feccfc1b6fe8df6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:24.571960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.573381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.585785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.628849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77297a6be4374f1ebc416dc2293b4b3b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.645824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:24.651586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.653379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77297a6be4374f1ebc416dc2293b4b3b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.657136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77297a6be4374f1ebc416dc2293b4b3b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.683087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77297a6be4374f1ebc416dc2293b4b3b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.685885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-af58b373-c7a1-43a0-b334-600d4fe3f357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77297a6be4374f1ebc416dc2293b4b3b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:24.719605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 854/1693] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:24 2022] DELETE /identity/v3/users/77297a6be4374f1ebc416dc2293b4b3b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:24.724583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.724954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.725297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.779991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:24.782292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.797875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 840/1694] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:24.817509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:24.819666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.837145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:24.877403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:24.916514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 855/1695] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:24.965708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c1a2-4e73-4223-8927-0f79b7ab722a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:24.985088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:25.138969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7851213-2a6a-4e19-8ebe-2daaf747a077 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:25.149465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:25.151067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.151067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.151217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.157412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:25.159311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.159711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.162170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.178405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:25.181637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e911-ac9d-4bfd-bb40-77090819ebfc service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:25.183425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:25.184850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de33f8-652d-467a-8668-ae6ffb9d8f23 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:25.209718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 856/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:25.216633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 841/1697] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:25.441407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54f7f-13e1-4ddd-a8d7-02b9569c11c2 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.441906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54f7f-13e1-4ddd-a8d7-02b9569c11c2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.442336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54f7f-13e1-4ddd-a8d7-02b9569c11c2 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.444238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 857/1698] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:25.557358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd658-77ed-4349-917d-f04e98420f51 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.557868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd658-77ed-4349-917d-f04e98420f51 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.557936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfd658-77ed-4349-917d-f04e98420f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.594392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-63bfd658-77ed-4349-917d-f04e98420f51 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:25.595678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63bfd658-77ed-4349-917d-f04e98420f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:25.726306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 842/1699] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:25.815317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296b52-8486-43cc-82e9-5b260fdc9e61 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.816326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296b52-8486-43cc-82e9-5b260fdc9e61 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.816837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296b52-8486-43cc-82e9-5b260fdc9e61 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.819187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 858/1700] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 23 13:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:25.826335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.826634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.827267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.859635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:25.860871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:25.886528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 843/1701] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 23 13:39:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:25.898982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6296b52-8486-43cc-82e9-5b260fdc9e61 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:25.927396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6296b52-8486-43cc-82e9-5b260fdc9e61 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:25.936613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:25.938576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:25.939078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:25.939830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:25.964003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:25.967684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144c773-a954-4b00-a14d-3a4d1f6e2fad service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:25.984919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 859/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:27.171733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:27.174467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:27.209748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e13779-79fb-4381-9e02-6687648f58d8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:27.222005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:27.223071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.223466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.223895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] PATH_INFO: `/v3/projects/fea0a1a7e2574c5a8ddc9ff93749c022` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.226182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea0a1a7e2574c5a8ddc9ff93749c022)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:27.231733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:27.375893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea0a1a7e2574c5a8ddc9ff93749c022', 'request_id': 'req-e99c5603-5a83-4bcf-83f9-0802a367b600'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.377855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:27.393339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea0a1a7e2574c5a8ddc9ff93749c022', 'request_id': 'req-e99c5603-5a83-4bcf-83f9-0802a367b600'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.408198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea0a1a7e2574c5a8ddc9ff93749c022', 'request_id': 'req-e99c5603-5a83-4bcf-83f9-0802a367b600'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.425278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] The token cache is being invalidate because project fea0a1a7e2574c5a8ddc9ff93749c022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:27.425858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.426667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.429222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 844/1703] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:27 2022] DELETE /identity/v3/projects/fea0a1a7e2574c5a8ddc9ff93749c022 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:27.433820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8af12-58a7-4efb-b74b-d66cf50f812c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.434335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8af12-58a7-4efb-b74b-d66cf50f812c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.434422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8af12-58a7-4efb-b74b-d66cf50f812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.471662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-19f8af12-58a7-4efb-b74b-d66cf50f812c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:27.472956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-19f8af12-58a7-4efb-b74b-d66cf50f812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:27.543275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:27.549452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:27.650704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 860/1704] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:27.660371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.660709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.661087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.696135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c5603-5a83-4bcf-83f9-0802a367b600 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:27.708631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:27.710021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:27.720900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:27.721822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.722111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.722395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] PATH_INFO: `/v3/projects/3de305ab79254f019b94bf7eb68d3cca` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.724547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de305ab79254f019b94bf7eb68d3cca)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:27.730251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:27.740865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 861/1705] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:27.743551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:27.778711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef3f8-c98c-4ecb-b9f4-e8820fa06a0c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:27.794316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:27.795312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.795312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.795594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.796339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:27.796850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:27.803161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:27.820797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 862/1706] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:27.846977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:27.880874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1a40-ef21-4bd7-bffc-556a074e6ea6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:27.917983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de305ab79254f019b94bf7eb68d3cca', 'request_id': 'req-ea1c68b1-03e7-483a-a317-d41976bc82f0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.938659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de305ab79254f019b94bf7eb68d3cca', 'request_id': 'req-ea1c68b1-03e7-483a-a317-d41976bc82f0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.946485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de305ab79254f019b94bf7eb68d3cca', 'request_id': 'req-ea1c68b1-03e7-483a-a317-d41976bc82f0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.973290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] The token cache is being invalidate because project 3de305ab79254f019b94bf7eb68d3cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:27.973638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.976090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:27.979105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 845/1707] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:27 2022] DELETE /identity/v3/projects/3de305ab79254f019b94bf7eb68d3cca => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:27.983387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:27.991420 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:28.043185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:28.044025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:28.044662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:28.045714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:28.052870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:28.062928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:28.071434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:28.146220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c68b1-03e7-483a-a317-d41976bc82f0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:28.162156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:28.163287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:28.163696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:28.163998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] PATH_INFO: `/v3/users/96b555a4d2db4ed0980dee9d95edcad9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:28.168529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b555a4d2db4ed0980dee9d95edcad9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:28.174238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:28.181149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 863/1708] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:27 2022] POST /identity/v3/projects => generated 365 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:28.188139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:28.197025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:28.202386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:28.333169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b555a4d2db4ed0980dee9d95edcad9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:28.363578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b555a4d2db4ed0980dee9d95edcad9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:28.402769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b555a4d2db4ed0980dee9d95edcad9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:28.403853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b555a4d2db4ed0980dee9d95edcad9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:28.488650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b555a4d2db4ed0980dee9d95edcad9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:28.527183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7beeb-5253-468d-a24b-623ffb172cce admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:28.533543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 846/1709] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:27 2022] DELETE /identity/v3/users/96b555a4d2db4ed0980dee9d95edcad9 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:28.759039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:28.759818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:28.760104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:28.760382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:28.761093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:28.763527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:28.840328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 864/1710] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:28 2022] POST /identity/v3/users => generated 283 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:28.841086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:28.842811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:28.875523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4209-79dc-42a0-bb2d-c573d7e9046a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:28.891754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:28.892456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:28.892742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:28.893187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:28.893941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:28.895618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:28.921416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 847/1711] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:39:28.933914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:28.964551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c5e-3b1e-4c71-b580-41a1b7fee53f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:28.987632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:28.988512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:28.988908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:28.989294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:28.990358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:28.995893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61346238-ea4b-42fd-ade4-63d1143b4081 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:29.026244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:29.036516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 865/1712] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:29.041352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97676f71-081c-4fac-bcc8-ba559812e243 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:29.069179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:29.070117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.070402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.070685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] PATH_INFO: `/v3/projects/d0356f463ffd4c4bae91c85b2295a418/users/6e5e3fbf4e4f4f05a7003e70fc7f5007/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.124395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0356f463ffd4c4bae91c85b2295a418, user_id=6e5e3fbf4e4f4f05a7003e70fc7f5007, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:29.128579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:29.163203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 848/1713] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:29 2022] PUT /identity/v3/projects/d0356f463ffd4c4bae91c85b2295a418/users/6e5e3fbf4e4f4f05a7003e70fc7f5007/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:29.173622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a5c6-1b25-465c-943a-95358e581808 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.175895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a5c6-1b25-465c-943a-95358e581808 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.176349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a5c6-1b25-465c-943a-95358e581808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.272446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cc90a5c6-1b25-465c-943a-95358e581808 None None] MFA Rules not processed for user `6e5e3fbf4e4f4f05a7003e70fc7f5007`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:29.273719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cc90a5c6-1b25-465c-943a-95358e581808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:29.460630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:29.475642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 866/1714] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:29.485478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:29.487942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:29.631664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba28fc-f361-4401-875f-17c32bfd5fae admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:29.638529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:29.639269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.639660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.639955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.665611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:29.668089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be305e8-d210-45ef-9505-16b5fab110aa service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:29.718995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 849/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:29.875630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.877746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.878400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.880343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 867/1716] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:29.912639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.913022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.913543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.954122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] MFA Rules not processed for user `76f162edbf8449589dcb9cf2bbd8cf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:29.957027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.088836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:30.135774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 850/1717] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:30.190533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:30.192407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.206944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:30.212383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.255236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f002c-530a-418e-8d2f-004a8ec12b1c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:30.273033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:30.273833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:30.274190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:30.274814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:30.297720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:30.305870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bceca-b9b2-4022-a337-eea8ceb4f1db service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:30.365179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 851/1718] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:30.366756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3756e-c542-4ce7-b9d7-27be833329ca None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:30.367049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3756e-c542-4ce7-b9d7-27be833329ca None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:30.367328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3756e-c542-4ce7-b9d7-27be833329ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:30.442354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5ad4-0b86-41d0-8a0d-6025a48688b8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:30.453388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-15e3756e-c542-4ce7-b9d7-27be833329ca None None] MFA Rules not processed for user `007ce9b8109343e0914efe94c6aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:30.456815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-15e3756e-c542-4ce7-b9d7-27be833329ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.458816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:30.459868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:30.461004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:30.461803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] PATH_INFO: `/v3/users/89b5b894f647493aa2db2b478d7925a0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:30.465795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b5b894f647493aa2db2b478d7925a0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:30.469785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:30.598942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b5b894f647493aa2db2b478d7925a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:30.601189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 852/1719] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:30.603189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:30.606425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b5b894f647493aa2db2b478d7925a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:30.607455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b5b894f647493aa2db2b478d7925a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:30.609677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:30.609970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:30.618326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b5b894f647493aa2db2b478d7925a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:30.619319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b1f75f1-6242-4b8e-a578-d6148684d3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b5b894f647493aa2db2b478d7925a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:30.641614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 868/1720] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:30 2022] DELETE /identity/v3/users/89b5b894f647493aa2db2b478d7925a0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:30.657249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] MFA Rules not processed for user `ae510389cfc04a0cb4e6991df2a93a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:30.658255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.761797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 853/1721] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:30.764443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:30.764765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:30.765136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:30.825009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] MFA Rules not processed for user `ae510389cfc04a0cb4e6991df2a93a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:30.836976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:30.851597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 869/1722] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:30.864422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:30.866255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.033836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f14d-7aed-4217-a6db-37c1ec3415fa None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.040691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:31.041482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.041703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.042147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.052695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:31.054335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:31.059010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:31.070100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 854/1723] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:31.318360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:31.320619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.331301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:31.334283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.452253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd2fc-319b-4210-9c42-10fa6e7677fb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.456367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfa6-24c1-4a33-a44a-37e2ccdd1d20 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.463896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:31.464828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.465116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.465398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] PATH_INFO: `/v3/projects/fc032917ef6c425cb7e8947d5ad218bf` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.468414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc032917ef6c425cb7e8947d5ad218bf)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:31.471737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:31.472639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.472977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.473265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] PATH_INFO: `/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.474776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:31.475797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a38b43018849e0a4ea7ec2cacf0978)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:31.479274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:31.512050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:31.581382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc032917ef6c425cb7e8947d5ad218bf', 'request_id': 'req-571bc2c4-bc57-4c19-8c20-0d4cf439545b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.599076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a38b43018849e0a4ea7ec2cacf0978', 'request_id': 'req-3c023cdb-edc6-432d-aa9e-2e7038cbca18'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.601597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc032917ef6c425cb7e8947d5ad218bf', 'request_id': 'req-571bc2c4-bc57-4c19-8c20-0d4cf439545b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.610818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc032917ef6c425cb7e8947d5ad218bf', 'request_id': 'req-571bc2c4-bc57-4c19-8c20-0d4cf439545b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.621918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a38b43018849e0a4ea7ec2cacf0978', 'request_id': 'req-3c023cdb-edc6-432d-aa9e-2e7038cbca18'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.634226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a38b43018849e0a4ea7ec2cacf0978', 'request_id': 'req-3c023cdb-edc6-432d-aa9e-2e7038cbca18'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.641333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] The token cache is being invalidate because project fc032917ef6c425cb7e8947d5ad218bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:31.641628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.642487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.644345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 870/1724] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:31 2022] DELETE /identity/v3/projects/fc032917ef6c425cb7e8947d5ad218bf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:31.648576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:31.655539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.665697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] The token cache is being invalidate because project a6a38b43018849e0a4ea7ec2cacf0978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:31.666391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.667414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3c023cdb-edc6-432d-aa9e-2e7038cbca18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:31.670262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 855/1725] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:31 2022] DELETE /identity/v3/projects/a6a38b43018849e0a4ea7ec2cacf0978 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:31.675983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44279-7702-4f48-883f-ea2a6fd66f8c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.676562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44279-7702-4f48-883f-ea2a6fd66f8c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.677586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44279-7702-4f48-883f-ea2a6fd66f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.715961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9cd44279-7702-4f48-883f-ea2a6fd66f8c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:31.717664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9cd44279-7702-4f48-883f-ea2a6fd66f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.849375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc2c4-bc57-4c19-8c20-0d4cf439545b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.885337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 856/1726] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:31.892780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.893244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.893794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.930654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:31.932144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.955280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 857/1727] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:31.959176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:31.985492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc195b1-9b0a-4e27-81df-d2e9998702d2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.992334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:31.993411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.993827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.994228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.995089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:31.995559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:31.997711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051ef1-81db-4626-ad49-271c60526657 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.026325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 858/1728] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:39:32.027764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd9b9-fe0d-4a3a-9a63-f6841d3fc679 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.028050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd9b9-fe0d-4a3a-9a63-f6841d3fc679 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.028322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd9b9-fe0d-4a3a-9a63-f6841d3fc679 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.039694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 859/1729] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 23 13:39:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:32.042651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af72f9-ff72-4587-98b5-e69a56a62aaa None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.042944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af72f9-ff72-4587-98b5-e69a56a62aaa None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.043224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af72f9-ff72-4587-98b5-e69a56a62aaa None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.044937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 860/1730] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 23 13:39:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:32.050052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af72f9-ff72-4587-98b5-e69a56a62aaa None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:32.066545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af72f9-ff72-4587-98b5-e69a56a62aaa None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:32.073189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:32.073918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.074362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.074717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.076164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:32.078219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bff02-c846-4e52-b8fb-1edc4f2c50e4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.084335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:32.104407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:32.109019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.109772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.110914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] PATH_INFO: `/v3/users/3b309af717a6492eb0767f00407538f0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.123286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b309af717a6492eb0767f00407538f0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:32.127462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.142066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 861/1731] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:32.143642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.143999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.144352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.214815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:32.220137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.234888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b309af717a6492eb0767f00407538f0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:32.241215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:32.252116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b309af717a6492eb0767f00407538f0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:32.252949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b309af717a6492eb0767f00407538f0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:32.272727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b309af717a6492eb0767f00407538f0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:32.273442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bf5dc55e-cd00-49fe-8b22-a85b30c6b963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b309af717a6492eb0767f00407538f0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:32.303554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 871/1732] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:31 2022] DELETE /identity/v3/users/3b309af717a6492eb0767f00407538f0 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:32.305634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.306004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.306363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.319995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 862/1733] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:32.321073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:32.322699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.329118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:32.330625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.465491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 872/1734] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:32.471859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:32.473534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.482216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b278-b186-4f39-b3dd-afb5b7d4e583 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:32.484964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3f47-571c-4439-926f-f3598e85414c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:32.491977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:32.492913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.493362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.494165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.508782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:32.514105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.540362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 873/1735] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:32.545393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:32.579219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097103-1312-44ea-8554-2528065a6480 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:32.599366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:32.600270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.600687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.601093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.617473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:32.619197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a068c-6d30-45be-9af7-fcf273f28da7 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.639962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 874/1736] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:32.641464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.641751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.642026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.674288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:32.679195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.679195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.679195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.679195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:32.683530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c09e6-a68c-4bb6-bef3-27c232e790cf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:32.724667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] MFA Rules not processed for user `d503b205ca214601a119535611899e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:32.727249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.741950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 863/1737] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/users => generated 297 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:32.747842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf48b-78bb-4083-b2d6-f06c42ff26bf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:32.748790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf48b-78bb-4083-b2d6-f06c42ff26bf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:32.750234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf48b-78bb-4083-b2d6-f06c42ff26bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:32.811502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7beaf48b-78bb-4083-b2d6-f06c42ff26bf None None] MFA Rules not processed for user `b191f41e53064acbaf17e3da073e7c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:32.813527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7beaf48b-78bb-4083-b2d6-f06c42ff26bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:32.846393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:32.937136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 875/1738] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:32.938065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:32.987453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897658bf-15f8-4bc0-abbc-bcb6f618fa69 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.003851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.004912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.008870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.009265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.012678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.017566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.042322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 864/1739] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:33.043891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.044213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.044556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.047286 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 876/1740] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:33.054523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.068177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296eda-a924-4f0a-bb45-3606097d4f44 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.074328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.075022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.075307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.076231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.078448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] MFA Rules not processed for user `d503b205ca214601a119535611899e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:33.079912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:33.080041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.081650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d76a3-5454-456f-8b2b-237365ecb376 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.095495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 865/1741] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:33.117884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 877/1742] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:33.120560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.150825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd57edc-dca7-4a80-95b9-ec5c40241f4c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.157910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.158830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.159112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.159454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] PATH_INFO: `/v3/projects/17a27286ef8240f5ba73994130fe0608/users/70c8cd95ba454798b076a0ec5eb4659f/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.194443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a27286ef8240f5ba73994130fe0608, user_id=70c8cd95ba454798b076a0ec5eb4659f, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.200981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.245632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 866/1743] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:33 2022] PUT /identity/v3/projects/17a27286ef8240f5ba73994130fe0608/users/70c8cd95ba454798b076a0ec5eb4659f/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:33.249147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.249436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.249717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.271556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.274779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:33.416420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] MFA Rules not processed for user `70c8cd95ba454798b076a0ec5eb4659f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:33.417685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:33.455190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:33.598615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef15a-ce42-4a4b-aab3-25f561a726c8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.625149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.626243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.626401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.626682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] PATH_INFO: `/v3/projects/411d2c83d607408284b3bad502b22ca8` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.628017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=411d2c83d607408284b3bad502b22ca8)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.629995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.633204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 878/1744] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:33.634551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.649800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ffe92-a44d-41ce-b1c8-2ed27fafdbef None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.656655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.657659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.658046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.658433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.659244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.661875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.716805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 879/1745] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:33.722104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.785730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411d2c83d607408284b3bad502b22ca8', 'request_id': 'req-b35a8667-fc72-421f-8f1a-40b6d8466eca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:33.808172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411d2c83d607408284b3bad502b22ca8', 'request_id': 'req-b35a8667-fc72-421f-8f1a-40b6d8466eca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:33.819664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411d2c83d607408284b3bad502b22ca8', 'request_id': 'req-b35a8667-fc72-421f-8f1a-40b6d8466eca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:33.840835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b4b5-9049-4637-a245-4e00e35f258a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.857980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] The token cache is being invalidate because project 411d2c83d607408284b3bad502b22ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:33.858268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:33.863483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b35a8667-fc72-421f-8f1a-40b6d8466eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:33.867449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 867/1746] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:33 2022] DELETE /identity/v3/projects/411d2c83d607408284b3bad502b22ca8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:33.873645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.874088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.875952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.965251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:33.985966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.005078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:34.064934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.068072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.068855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.069308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.070253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.073598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.109388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 880/1747] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/users => generated 303 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:34.110787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.114668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.176396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:34.192676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 868/1748] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:34.193969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.201283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.298946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6728df-250e-4c3b-a599-c5629ee96c19 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.315750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.316561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.316859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.317210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.328439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.381642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca953a69-ccb6-4344-a07a-9c8149fa973d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.404256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.407163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.407588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.408667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.414771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.443817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.445137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.447558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.448781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.474524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 869/1749] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:34.475427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.479309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.487910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 881/1750] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:34.488928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.493016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.523969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d7b5-eb50-44e8-9f43-662d40779809 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.552543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52bd5-fc23-4741-b157-87bd1709429f service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.569640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.571830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.572369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.572849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.574437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.575266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.576173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.576462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.583576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.621943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.626955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.677681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 882/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:34.691320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.700521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.752212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.756265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b0f7-dab3-4c78-8dcc-9283dfdd7a0c service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.772723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296669-d137-42e7-8b34-b18f1a877ca7 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.788096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 870/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:34.789840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.790130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.791952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.793811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.794615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.794921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.795166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.795910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:34.797514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:34.843991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 883/1753] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:34.844932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:34.866770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:34.871126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:34.885766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f61206-947f-4b2f-9829-f5ac7235a35f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:34.914357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:34.916127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:34.916649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:34.919767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] PATH_INFO: `/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a/users/45b481a4570c451b92fe6c4815cbef80/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:34.955121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 871/1754] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:34.962477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.003550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef02e6e6e8f4dcba75ee4073773109a, user_id=45b481a4570c451b92fe6c4815cbef80, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.007783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.011058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4e73f-95f4-4756-90fb-fd699cf69ac9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.024077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.024845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.025149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.026651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.030634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:35.033251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.035219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.042305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 884/1755] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:34 2022] PUT /identity/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a/users/45b481a4570c451b92fe6c4815cbef80/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:35.046411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.075076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 872/1756] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:35.084193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.117570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981b2a-bbf6-4c80-a1c7-2763f9fa183f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.163565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:35.276853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c053-2834-4bf4-9e9b-70f7e0ed3edc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.291394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.292243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.293606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.294447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.295769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.303138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.327071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 885/1757] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:35.331251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.355142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.356009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.356121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae147-93d0-4992-b9ef-17909af4ed91 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.356554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.356922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.357868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.363585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f44552-3cc1-4333-afd9-aed2d78901e7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.378779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.381134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.382450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.384468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] PATH_INFO: `/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a/users/45b481a4570c451b92fe6c4815cbef80/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.391832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef02e6e6e8f4dcba75ee4073773109a, user_id=45b481a4570c451b92fe6c4815cbef80, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.394891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.417032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:35.445243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 886/1758] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:35 2022] PUT /identity/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a/users/45b481a4570c451b92fe6c4815cbef80/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:35.448704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.450324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 873/1759] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:35 2022] POST /identity/v3/projects => generated 389 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:35.465780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.466163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.466544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.550099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] MFA Rules not processed for user `45b481a4570c451b92fe6c4815cbef80`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:35.551716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:35.665110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 874/1760] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:35.678123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.682589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1d9e8-d9cb-490a-860c-17090016fb8d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.683835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:35.842061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.845080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.847362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.848304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.850704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.856865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b459f0-af3f-4cb3-aa9e-87f840d01d46 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.890524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af20cf-d43b-4a0d-a2b2-7ac9848a3136 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.902444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 887/1761] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:35 2022] POST /identity/v3/users => generated 295 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:35.904700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.905648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.906181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.914212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.914878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.915157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.915459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.947087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] MFA Rules not processed for user `ae510389cfc04a0cb4e6991df2a93a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:35.947985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.949374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:35.949533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.983073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 875/1762] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:35.984468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.012489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d17e2-49dc-4634-94f0-238ab4467a14 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:36.036337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:36.037220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.038442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.042180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.043188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:36.047701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:36.089052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 876/1763] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:36.094044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.124567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2c32-6acc-4d8f-8422-18b89d372729 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:36.135924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 888/1764] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:36.172449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:36.173134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.173418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.173690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.174422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:36.183873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:36.231981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 877/1765] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:36.233537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.268854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd591b-e15e-4363-97b9-b9b4406a5f12 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:36.285321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:36.287322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.287621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.288497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] PATH_INFO: `/v3/projects/b557a1616f9b4279b7f8df0869108104/users/a722b76a9c31402eaeb8ee8c28b4e3ab/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.342112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b557a1616f9b4279b7f8df0869108104, user_id=a722b76a9c31402eaeb8ee8c28b4e3ab, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:36.348408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860138-7074-4541-bd89-ad12f1c4d8f0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:36.361126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.373796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aabd59-b4d0-41e2-9647-8edb54abba38 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:36.380473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:36.382452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.382749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.383030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.388555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:36.398548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 889/1766] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:36 2022] PUT /identity/v3/projects/b557a1616f9b4279b7f8df0869108104/users/a722b76a9c31402eaeb8ee8c28b4e3ab/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:36.409710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:36.411880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.412176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.412453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.478989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:36.493588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] MFA Rules not processed for user `a722b76a9c31402eaeb8ee8c28b4e3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:36.500216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:36.511677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:36.514698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:36.532982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 878/1767] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:36.736867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 890/1768] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:36.738178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.767830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad28b9-4055-4783-9e16-a460dcc9dd40 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.003830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.004531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.005019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.005309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.006020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.011536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.107391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 879/1769] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:36 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:37.107573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.128468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fda52-a79f-4e32-8001-62bdc2970ff4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.284402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.285246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.285628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.286000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.287304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.292259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.356880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 891/1770] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:37 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:37.359305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.378949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d8dc-d18f-4750-8553-16c7aa8926ca admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.394071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.397507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.399486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.399780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.404015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.410327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.459268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.463017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 880/1771] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:37.474492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9b25-323d-4898-8272-11d9ea530028 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.494580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.496269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.496763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.497792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] PATH_INFO: `/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15/users/55b68a9320c04049ab784fcce1a0c6d0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.554943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a775e8fe404155b1fc54d5e02d4e15, user_id=55b68a9320c04049ab784fcce1a0c6d0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.566554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.611398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 892/1772] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:37 2022] PUT /identity/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15/users/55b68a9320c04049ab784fcce1a0c6d0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:37.615373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.631243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84014-9f36-4d0d-9910-46d4b85d66a7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.847801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.850669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.852644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.853428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.856172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.873967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519dbe9-f490-4238-af85-bbf9bab48a69 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.909280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 881/1773] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:37.913354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.946290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a2fae-e4fe-400f-a85b-b7680398fb9b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.967710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.969586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.970162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.970760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] PATH_INFO: `/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15/users/55b68a9320c04049ab784fcce1a0c6d0/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.973816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a775e8fe404155b1fc54d5e02d4e15, user_id=55b68a9320c04049ab784fcce1a0c6d0, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.977771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:38.022134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 893/1774] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:37 2022] PUT /identity/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15/users/55b68a9320c04049ab784fcce1a0c6d0/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:38.033224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d918e-fd17-47db-9690-c67728b88530 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:38.033721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d918e-fd17-47db-9690-c67728b88530 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:38.033809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d918e-fd17-47db-9690-c67728b88530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:38.102491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-527d918e-fd17-47db-9690-c67728b88530 None None] MFA Rules not processed for user `55b68a9320c04049ab784fcce1a0c6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:38.103816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-527d918e-fd17-47db-9690-c67728b88530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:38.128919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:38.280734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 882/1775] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:38.299469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:38.423997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0bb8-a7dd-4909-be11-132cea1c0b4b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:38.428442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:38.429288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:38.429753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:38.430174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:38.452670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:38.454413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a090-d6bc-42a4-bcfc-9995c7ec89be service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:38.464360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:38.487854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 894/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:38.731006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d918e-fd17-47db-9690-c67728b88530 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:38.990527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d918e-fd17-47db-9690-c67728b88530 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:39.023696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:39.024608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:39.024889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:39.041375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] PATH_INFO: `/v3/users/a722b76a9c31402eaeb8ee8c28b4e3ab` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:39.055279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a205-532a-4eee-809d-392b9c939214 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:39.055822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a205-532a-4eee-809d-392b9c939214 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:39.055895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a205-532a-4eee-809d-392b9c939214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:39.065055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a722b76a9c31402eaeb8ee8c28b4e3ab)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:39.067050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:39.118782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7795a205-532a-4eee-809d-392b9c939214 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:39.122510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7795a205-532a-4eee-809d-392b9c939214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:39.287743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a722b76a9c31402eaeb8ee8c28b4e3ab'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:39.298590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a722b76a9c31402eaeb8ee8c28b4e3ab'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:39.322355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a722b76a9c31402eaeb8ee8c28b4e3ab'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:39.323440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a722b76a9c31402eaeb8ee8c28b4e3ab'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:39.362576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a722b76a9c31402eaeb8ee8c28b4e3ab'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:39.384510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 895/1777] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:39.385025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 883/1778] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:38 2022] DELETE /identity/v3/users/a722b76a9c31402eaeb8ee8c28b4e3ab => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:39.391032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:39.391032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:39.391403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:39.458124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:39.468492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:39.704053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 896/1779] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:39.769685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:39.771162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:39.847418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:39.848811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:39.899704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:40.036716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c86a1-2053-4f84-b936-9cbbcd2fa63a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:40.040435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8c6c-6c66-46d3-8259-ab9b7312fb1b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:40.047820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:40.048691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:40.049113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:40.049918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:40.050879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:40.052483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:40.053048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:40.054771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:40.085262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:40.087192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec71bc-0d5e-4b72-adc4-0ff92350ec33 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:40.132680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 897/1780] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:40.204238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:40.207448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa972fc3-3ccb-4dc5-a70d-94dec67946b1 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:40.239055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 884/1781] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:41.478262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:41.478262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:41.478262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:41.553264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] MFA Rules not processed for user `b191f41e53064acbaf17e3da073e7c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:41.554551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:41.860915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:41.907428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 898/1782] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:43.290152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:43.290953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:43.291440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:43.337940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:43.341505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:43.373837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 885/1783] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 23 13:39:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:43.516876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:43.528958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f6cd-ba25-4498-b701-a127faefdf9d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:43.566798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:43.567773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:43.568225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:43.568794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:43.627814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:43.629292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f6a07-1e07-4b0d-9c86-552b6a4cb36d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:43.664572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:43.666281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:43.677120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 899/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:43.733788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc19fc-1795-41bf-ac92-cc444cbef3a7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:43.778238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:43.779323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:43.781424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:43.782575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] PATH_INFO: `/v3/users/70c8cd95ba454798b076a0ec5eb4659f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:43.792786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c8cd95ba454798b076a0ec5eb4659f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:43.795467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:44.022234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c8cd95ba454798b076a0ec5eb4659f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:44.057840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c8cd95ba454798b076a0ec5eb4659f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:44.086430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c8cd95ba454798b076a0ec5eb4659f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:44.101585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c8cd95ba454798b076a0ec5eb4659f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:44.174832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c8cd95ba454798b076a0ec5eb4659f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:44.212988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:44.213483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 886/1785] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:43 2022] DELETE /identity/v3/users/70c8cd95ba454798b076a0ec5eb4659f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:44.214091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:44.215163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:44.270597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:44.274185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:44.486683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 900/1786] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:44.548267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:44.550800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:44.666046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:44.729910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a314ab-8fee-4792-bc32-9d0db9b545f3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:44.739694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:44.740618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:44.741231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:44.741916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:44.764094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:44.765941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9d442-a396-4046-b3b5-72424debe18f service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:44.794366 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 887/1787] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:44.966749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:44.968938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:44.994105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e1ab-5b09-4060-a0f3-738d5b40e904 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:45.022999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:45.024172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:45.024564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:45.024958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] PATH_INFO: `/v3/users/fe9006a01b40434e9a47c02eb207826d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:45.028712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9006a01b40434e9a47c02eb207826d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:45.034755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:45.190315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9006a01b40434e9a47c02eb207826d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:45.206786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9006a01b40434e9a47c02eb207826d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:45.207735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9006a01b40434e9a47c02eb207826d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:45.233287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9006a01b40434e9a47c02eb207826d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:45.234046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9006a01b40434e9a47c02eb207826d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:45.295047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 901/1788] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:44 2022] DELETE /identity/v3/users/fe9006a01b40434e9a47c02eb207826d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:45.299680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:45.300088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:45.300509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:45.329223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:45.330773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:45.489337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 888/1789] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:45.734881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:45.737008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:45.895300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611a445-b929-41a7-879e-1b075158ca1b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:45.900654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:45.901868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:45.902514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:45.903107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:45.913143 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:45.927408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:45.932138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:45.957103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 902/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:46.890814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:46.894273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:46.927730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccca8e-7dea-4c4a-b5ab-f7be38d18d2e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:46.937213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:46.942210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:46.943829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:46.944444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] PATH_INFO: `/v3/projects/b557a1616f9b4279b7f8df0869108104` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:46.947076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b557a1616f9b4279b7f8df0869108104)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:46.950981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:47.387664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b557a1616f9b4279b7f8df0869108104', 'request_id': 'req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.401676 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b557a1616f9b4279b7f8df0869108104', 'request_id': 'req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.413362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b557a1616f9b4279b7f8df0869108104', 'request_id': 'req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.435068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] The token cache is being invalidate because project b557a1616f9b4279b7f8df0869108104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:47.436210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.437872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-13c9c78f-6e88-4caa-8be4-3aaa437b73f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.441252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 889/1791] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:46 2022] DELETE /identity/v3/projects/b557a1616f9b4279b7f8df0869108104 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:47.445649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:47.462712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82a25b-2e90-49f0-a64f-19e94eb8cd27 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:47.521191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecf522-1bec-4b22-930c-5e939848269e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:47.521916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecf522-1bec-4b22-930c-5e939848269e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:47.522335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecf522-1bec-4b22-930c-5e939848269e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:47.524567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 890/1792] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:47.536058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:47.536566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:47.537019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:47.583167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:47.584458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:47.686522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:47.687806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:47.688245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:47.688652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] PATH_INFO: `/v3/users/55b68a9320c04049ab784fcce1a0c6d0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:47.690561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b68a9320c04049ab784fcce1a0c6d0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:47.692529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:47.744875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:47.772474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b68a9320c04049ab784fcce1a0c6d0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.796681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 891/1793] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:47.797801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:47.797955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b68a9320c04049ab784fcce1a0c6d0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.799961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b68a9320c04049ab784fcce1a0c6d0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.800768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:47.819464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b68a9320c04049ab784fcce1a0c6d0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.822311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b68a9320c04049ab784fcce1a0c6d0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:47.854220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef9737-f840-45ae-85f6-79b68818a371 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:47.865081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:47.873525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:47.873976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:47.874361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] PATH_INFO: `/v3/users/6e5e3fbf4e4f4f05a7003e70fc7f5007` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:47.876279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5e3fbf4e4f4f05a7003e70fc7f5007)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:47.878831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:47.894315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 903/1794] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:47 2022] DELETE /identity/v3/users/55b68a9320c04049ab784fcce1a0c6d0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:47.896623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:47.901392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.036596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5e3fbf4e4f4f05a7003e70fc7f5007'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.048062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f28e31-64c9-41c1-8d8c-085ba9262554 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:48.054856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:48.055712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:48.056005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:48.056291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:48.059141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.066155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5e3fbf4e4f4f05a7003e70fc7f5007'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.073641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:48.075821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:48.081924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:48.091937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 904/1795] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:48.093036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:48.094801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.105352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5e3fbf4e4f4f05a7003e70fc7f5007'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.106627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5e3fbf4e4f4f05a7003e70fc7f5007'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.163992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d47043d7-c977-4c1f-808d-d4ff0071be08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5e3fbf4e4f4f05a7003e70fc7f5007'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.178198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 892/1796] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:47 2022] DELETE /identity/v3/users/6e5e3fbf4e4f4f05a7003e70fc7f5007 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:48.193796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:48.194200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:48.194488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:48.249803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:48.254584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.379088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d3a8-9fd9-4e6d-8e94-6f8321e3f4b7 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:48.510454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 893/1797] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:48.510454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:48.512078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.526562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ad39-4421-4498-8a38-5b37ee89054c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:48.535867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:48.536891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:48.538129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:48.538467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] PATH_INFO: `/v3/projects/c1b51b7825474d18b81600c911fdd45f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:48.541307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b51b7825474d18b81600c911fdd45f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:48.544278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:48.619710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:48.623380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:48.629641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:48.634223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] PATH_INFO: `/v3/projects/17a27286ef8240f5ba73994130fe0608` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:48.636675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a27286ef8240f5ba73994130fe0608)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:48.644553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:48.704175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b51b7825474d18b81600c911fdd45f', 'request_id': 'req-b882ddf5-6dfd-439e-91be-52069263f15f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.717704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:48.727219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b51b7825474d18b81600c911fdd45f', 'request_id': 'req-b882ddf5-6dfd-439e-91be-52069263f15f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.744525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b51b7825474d18b81600c911fdd45f', 'request_id': 'req-b882ddf5-6dfd-439e-91be-52069263f15f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.753523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a27286ef8240f5ba73994130fe0608', 'request_id': 'req-6b475594-f846-4d87-8d58-881a2a70ce57'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.765290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] The token cache is being invalidate because project c1b51b7825474d18b81600c911fdd45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:48.765694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.767641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.775005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 894/1798] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:48 2022] DELETE /identity/v3/projects/c1b51b7825474d18b81600c911fdd45f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:48.776129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:48.779625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.785928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a27286ef8240f5ba73994130fe0608', 'request_id': 'req-6b475594-f846-4d87-8d58-881a2a70ce57'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.808782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a27286ef8240f5ba73994130fe0608', 'request_id': 'req-6b475594-f846-4d87-8d58-881a2a70ce57'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.846406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] The token cache is being invalidate because project 17a27286ef8240f5ba73994130fe0608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:48.846991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.848990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:48.852800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 905/1799] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:48 2022] DELETE /identity/v3/projects/17a27286ef8240f5ba73994130fe0608 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:48.856483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:48.860219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:48.977955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ddf5-6dfd-439e-91be-52069263f15f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:48.991674 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:49.086384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475594-f846-4d87-8d58-881a2a70ce57 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:49.136767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:49.137984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:49.138577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:49.138577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] PATH_INFO: `/v3/users/0bde89b00c1e4ba59c8c79e80bf789fb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:49.142470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bde89b00c1e4ba59c8c79e80bf789fb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:49.153326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:49.182430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:49.183909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:49.186813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:49.187300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:49.194513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:49.230589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:49.234544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:49.257957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bde89b00c1e4ba59c8c79e80bf789fb'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.258328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 895/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:49.260294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:49.264241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:49.283407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bde89b00c1e4ba59c8c79e80bf789fb'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.284564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bde89b00c1e4ba59c8c79e80bf789fb'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.290625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b8b4-d7fb-48b2-ba7f-661bae92c0e5 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:49.299498 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:49.300418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:49.300702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:49.300980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] PATH_INFO: `/v3/users/45b481a4570c451b92fe6c4815cbef80` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:49.302265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b481a4570c451b92fe6c4815cbef80)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:49.304314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:49.316914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bde89b00c1e4ba59c8c79e80bf789fb'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.318410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bde89b00c1e4ba59c8c79e80bf789fb'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.398475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 906/1801] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:48 2022] DELETE /identity/v3/users/0bde89b00c1e4ba59c8c79e80bf789fb => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:49.425637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b481a4570c451b92fe6c4815cbef80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.450599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b481a4570c451b92fe6c4815cbef80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.468898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b481a4570c451b92fe6c4815cbef80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.469777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b481a4570c451b92fe6c4815cbef80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.557589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f668b096-229e-4e85-8dd0-216dda746623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b481a4570c451b92fe6c4815cbef80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:49.578348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:49.580518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:49.592534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 896/1802] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:49 2022] DELETE /identity/v3/users/45b481a4570c451b92fe6c4815cbef80 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:49.747895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22efab7-46db-45fd-879b-1fd965ac8fc7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:49.923725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:49.926092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:49.926380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:49.926662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] PATH_INFO: `/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:49.930804 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a775e8fe404155b1fc54d5e02d4e15)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:49.947629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:49.956687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:50.074626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862200-4f94-4bac-9463-95d2f6d2ae53 None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.074982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862200-4f94-4bac-9463-95d2f6d2ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.075275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14862200-4f94-4bac-9463-95d2f6d2ae53 None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.078047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 897/1803] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:39:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:50.157195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5821-c720-477d-b38d-b826092bc03e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.157497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5821-c720-477d-b38d-b826092bc03e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.157785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5821-c720-477d-b38d-b826092bc03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.171432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a775e8fe404155b1fc54d5e02d4e15', 'request_id': 'req-3bc1898e-1b9c-4914-94e6-72ec27934878'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:50.191769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a775e8fe404155b1fc54d5e02d4e15', 'request_id': 'req-3bc1898e-1b9c-4914-94e6-72ec27934878'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:50.216103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a775e8fe404155b1fc54d5e02d4e15', 'request_id': 'req-3bc1898e-1b9c-4914-94e6-72ec27934878'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:50.238077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7eeb5821-c720-477d-b38d-b826092bc03e None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:50.241825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7eeb5821-c720-477d-b38d-b826092bc03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:50.244949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] The token cache is being invalidate because project d5a775e8fe404155b1fc54d5e02d4e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:50.257982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:50.257982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-3bc1898e-1b9c-4914-94e6-72ec27934878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:50.257982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 907/1804] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:49 2022] DELETE /identity/v3/projects/d5a775e8fe404155b1fc54d5e02d4e15 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:50.260647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.268093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.268738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.286973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:50.343912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:50.345387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:50.435622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 898/1805] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:50.537021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 908/1806] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:50.545151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.545550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.545960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.574082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:50.577830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:50.588834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 899/1807] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:50.593036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:50.613229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf28cdd-06bd-46dd-a262-a00e7f17b5e1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:50.630717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:50.631986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.632356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.632728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.633795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:50.634545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:50.636915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:50.653558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 909/1808] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:39:50.659360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:50.674255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393fff6-9afb-4910-ad5c-c3ef804e5719 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:50.695896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:50.702269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:50.702269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:50.702269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:50.702269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:50.702269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:50.768488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 900/1809] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:50 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:50.773384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:50.802606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d98d6-a99b-485e-b2ce-403e9cd9f54f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.003517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.006513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:51.023299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.024138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.024544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.024922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.025755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.035886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.080555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 910/1810] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:50 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:51.081545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.107316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62d674-7228-4d0a-acc1-53dc966ae9a4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.117490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.118400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.119672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.120059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.121088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.124538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.128033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:51.155927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 911/1811] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:51.157441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.169195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19078b78-bbbe-47a2-98c7-5782ab59b9e9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.171298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa002-0da1-4843-896c-158fbf968425 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.176362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.177115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.181082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.181082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.188128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.189023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.190410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.190838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.192774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.195503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.196026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.201114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4afe5-413c-4a2c-8b7f-6aebfb69c259 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.225510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 912/1812] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:51.229933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.241489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 901/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:51.261277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cb0b-baca-4b07-ba50-f7827d567954 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.275384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.277537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.278586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.279010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] PATH_INFO: `/v3/projects/d0379e59550245f6b75828db6adb06cb/users/de9050cdfc2d4109ac9a5d624d26bae4/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.313305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0379e59550245f6b75828db6adb06cb, user_id=de9050cdfc2d4109ac9a5d624d26bae4, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.330344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.373325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 913/1814] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:51 2022] PUT /identity/v3/projects/d0379e59550245f6b75828db6adb06cb/users/de9050cdfc2d4109ac9a5d624d26bae4/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:51.385031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970242d-41ee-402a-a835-1a43c617123f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.385543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970242d-41ee-402a-a835-1a43c617123f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.385979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970242d-41ee-402a-a835-1a43c617123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.438399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f970242d-41ee-402a-a835-1a43c617123f None None] MFA Rules not processed for user `de9050cdfc2d4109ac9a5d624d26bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:51.439997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f970242d-41ee-402a-a835-1a43c617123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:51.576858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:51.615364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 902/1815] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:51.619481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.748406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae7d6-efb9-4854-a30a-0340523c33df admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:51.754826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:51.765107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:51.765536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:51.765964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:51.767698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:51.770768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:51.816155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970242d-41ee-402a-a835-1a43c617123f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.818405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f970242d-41ee-402a-a835-1a43c617123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:51.820545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 914/1816] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:51.824230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:51.874088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970242d-41ee-402a-a835-1a43c617123f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.031638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c0488-2c06-4ebb-a6a6-1b88decd668f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.049460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.050238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.050691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.050971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.051699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.055489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.086658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.087902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.088475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.089024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] PATH_INFO: `/v3/projects/d0356f463ffd4c4bae91c85b2295a418` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.093267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0356f463ffd4c4bae91c85b2295a418)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.099349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.105422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 915/1817] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:51 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:52.112483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.131104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65f05-9be5-46bd-894d-495af9f5600c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.150085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.150780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.151061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.151355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.155910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.157736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.180251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 916/1818] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:52.193513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.225396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0356f463ffd4c4bae91c85b2295a418', 'request_id': 'req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.230564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d257eb-f67e-4554-a1ef-883b505ecb17 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.243531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0356f463ffd4c4bae91c85b2295a418', 'request_id': 'req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.253988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0356f463ffd4c4bae91c85b2295a418', 'request_id': 'req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.275384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] The token cache is being invalidate because project d0356f463ffd4c4bae91c85b2295a418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:52.275729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.276450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.278334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 903/1819] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:51 2022] DELETE /identity/v3/projects/d0356f463ffd4c4bae91c85b2295a418 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:52.278918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.280244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.285246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:52.352018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.352690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.353579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.353579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.359942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.361797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113e5e-7f5e-420c-8a3c-a7389c438d26 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.387963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e2ce-3ed2-4e9c-afee-01b362c0f5b9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.399065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.400532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.400897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.401374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] PATH_INFO: `/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.403048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef02e6e6e8f4dcba75ee4073773109a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.406595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.410738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 917/1820] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:52.414168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.414597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.415031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.460203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.463738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.463965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:52.489140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 918/1821] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:52.490205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.491996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.499675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef02e6e6e8f4dcba75ee4073773109a', 'request_id': 'req-705c018f-a7b6-4253-8d09-a0b2f23fc811'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.507759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ad80-b71d-4e64-99b8-4ef0849f65f1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.509592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef02e6e6e8f4dcba75ee4073773109a', 'request_id': 'req-705c018f-a7b6-4253-8d09-a0b2f23fc811'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.523591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef02e6e6e8f4dcba75ee4073773109a', 'request_id': 'req-705c018f-a7b6-4253-8d09-a0b2f23fc811'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.540811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] The token cache is being invalidate because project 1ef02e6e6e8f4dcba75ee4073773109a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:52.541281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.542067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.545132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 904/1822] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:52 2022] DELETE /identity/v3/projects/1ef02e6e6e8f4dcba75ee4073773109a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:52.546132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.548155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.612752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.614573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.614830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.615398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] PATH_INFO: `/v3/projects/a8bbea5414e24fbe9ded028c7b03df85/users/c5bea114e65c484182f7fbedc39c0783/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.644208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8bbea5414e24fbe9ded028c7b03df85, user_id=c5bea114e65c484182f7fbedc39c0783, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.653704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0f957-01ee-4688-a211-9343beaec201 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.661818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c018f-a7b6-4253-8d09-a0b2f23fc811 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.667721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.669091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.669372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.669719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] PATH_INFO: `/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.671168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e2021dd865437593cd8e0c8ce1ec51)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.673225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.677874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 919/1823] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:52 2022] PUT /identity/v3/projects/a8bbea5414e24fbe9ded028c7b03df85/users/c5bea114e65c484182f7fbedc39c0783/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:52.679409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e063c-bfb3-4235-8b13-d7da99019fb2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.679854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e063c-bfb3-4235-8b13-d7da99019fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.680458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e063c-bfb3-4235-8b13-d7da99019fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.705281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f73e063c-bfb3-4235-8b13-d7da99019fb2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.706786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f73e063c-bfb3-4235-8b13-d7da99019fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.773961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e2021dd865437593cd8e0c8ce1ec51', 'request_id': 'req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.788808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e2021dd865437593cd8e0c8ce1ec51', 'request_id': 'req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.799488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e2021dd865437593cd8e0c8ce1ec51', 'request_id': 'req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.809398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 920/1824] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:52.811019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.811986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.812277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.818891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] The token cache is being invalidate because project b9e2021dd865437593cd8e0c8ce1ec51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:52.819905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.820426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c6cd29a6-f66d-4f05-b4b6-5b95a719d3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:52.826534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 905/1825] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:52 2022] DELETE /identity/v3/projects/b9e2021dd865437593cd8e0c8ce1ec51 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:52.829330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5851fe-216c-4932-86a3-71c970e5784e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.829949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5851fe-216c-4932-86a3-71c970e5784e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.830412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5851fe-216c-4932-86a3-71c970e5784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.835784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.837345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.860664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7e5851fe-216c-4932-86a3-71c970e5784e None None] MFA Rules not processed for user `c5bea114e65c484182f7fbedc39c0783`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.861811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7e5851fe-216c-4932-86a3-71c970e5784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.873162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:52.894839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:52.906827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 921/1826] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:52.908149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.910023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.922709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd57ca-c228-40d4-8e03-e24fd914fa97 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:52.927408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:52.928195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.928483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.929900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.929900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:52.929900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:52.931397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b56b0e-b96b-440e-9b36-0d38e5192b2b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:52.941180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 906/1827] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:52.942692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.943387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.943387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.950479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 922/1828] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:52.950479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:52.950479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:52.950479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:52.974899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.976367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.990250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 923/1829] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:52.991027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:52.991726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:52.992656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:52.993051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:53.004616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 907/1830] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:53.005412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.015788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401b770-d671-463a-a17c-0a16cbf8fc74 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.016328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cae7-d811-44e9-a16a-4f2bff963c6c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.020826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.021507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.021788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.022205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.022756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.024328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.025009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.025472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.025904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.026316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.027517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.030096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e55b-38e0-409d-8819-72de73bbb041 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.060021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 924/1831] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:52 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.061283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.069617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 908/1832] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.069617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.069617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.069617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.087902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:53.089134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:53.138673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f9f2e-e88f-467c-951e-b18901c09f55 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.157523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 909/1833] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:53.160984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.169714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b33e0-a799-48ad-86e8-f293322e88e2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.175428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.176345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.176631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.176913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.177612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.180142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.201734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.202418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.202976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.203250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.205041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:53.205041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.205903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.213787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 910/1834] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.213787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.228557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 925/1835] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:53.230351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51a69-c80f-4015-bccd-3f6cd066d559 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.233575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.235450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.236159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.236389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.236663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.237355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.239501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.244240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178bd0e-5c09-459a-8b4f-500f5bf464ac admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.251183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.251974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.252221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.252532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.253311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:53.253645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.255328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.268134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 911/1836] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/users => generated 303 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.272196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.278521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 926/1837] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:53.278873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.289787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b84295-5a83-415c-8113-321791d82ba0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.293932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720935-2da1-4a82-9d8a-064f148ed559 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.298614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.299398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.299683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.299955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.300068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.300646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.300748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.301095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.301437 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.302244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.302597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.304018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.317302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 912/1838] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.318045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.333107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ad2e-2901-4261-a7b9-23be5ed8da6b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.335397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 927/1839] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.336568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.337853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.338605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.338894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.339167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.339937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.341823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.342554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.358937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 913/1840] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.358937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.369080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b91e18-e1c7-4916-a77b-0344a9d9c601 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.408566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b97e-9897-4007-8e73-5efdd2b348e6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.413584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.414352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.414767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.414901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.415785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.417232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.417878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.444206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.445357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.445764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.446319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] PATH_INFO: `/v3/projects/d2464731bd804c46ba438530c6183afc/users/a63dbec5093f4aea81280d4ad81c3b49/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.456430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 928/1841] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.457729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.468161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2464731bd804c46ba438530c6183afc, user_id=a63dbec5093f4aea81280d4ad81c3b49, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.471228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.491813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 914/1842] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:53 2022] PUT /identity/v3/projects/d2464731bd804c46ba438530c6183afc/users/a63dbec5093f4aea81280d4ad81c3b49/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:53.492861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.537067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3bcd9-7782-4352-b7a4-1bb25cb0b64c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.619293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.620560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.620943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.621047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741a0d-be89-4534-bac7-45723a1c77d5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.621555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.622817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.625330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.627673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.628479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.628815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.629232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.629988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.633296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.648699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 915/1843] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.648699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.656822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7552f9-d447-444d-98e5-e7d680d6647d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.661102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 929/1844] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.662200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.662978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.664531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.664886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.665239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.666133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.673762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.677330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa16e-385b-4bc5-9144-ec9f83003948 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.682785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.683904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.684387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.684961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.685778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.687761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.703413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 930/1845] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.703413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.703929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 916/1846] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/users => generated 282 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:53.707753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.714758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2166ed-5575-451c-9fd2-23f704ec8cbb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.723044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd56685-aa51-419a-ae90-00f45b439a24 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.729786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.730487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.730766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.731134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.731446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.731997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.732597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.732883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.733152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] PATH_INFO: `/v3/projects/ac0f2637ee4741cc81a4e7ae02f747b6/users/c579d6909981454d96ae932fe85b6c05/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.733635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.756161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 917/1847] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.757090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.763386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.771150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d521-e099-46d1-a012-deae227e064a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.775203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0f2637ee4741cc81a4e7ae02f747b6, user_id=c579d6909981454d96ae932fe85b6c05, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.777503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.778421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.779260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.779747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.780241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] PATH_INFO: `/v3/projects/d2464731bd804c46ba438530c6183afc/users/a63dbec5093f4aea81280d4ad81c3b49/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.783114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2464731bd804c46ba438530c6183afc, user_id=a63dbec5093f4aea81280d4ad81c3b49, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.786304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.801532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 918/1848] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:53 2022] PUT /identity/v3/projects/d2464731bd804c46ba438530c6183afc/users/a63dbec5093f4aea81280d4ad81c3b49/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:53.802699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.813247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 931/1849] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:53 2022] PUT /identity/v3/projects/ac0f2637ee4741cc81a4e7ae02f747b6/users/c579d6909981454d96ae932fe85b6c05/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:53.814364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:53.911003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c199b7-a467-4027-af12-aa5d14463514 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.932240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b753-1e12-422a-8125-1b3f4f4e6787 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:53.938649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:53.939592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.940168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.941197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.941829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:53.943905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada8b76-d235-4381-a50f-18e96f112688 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:53.958188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 932/1850] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:53.960102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:53.960505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:53.960880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:53.970427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.998531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] MFA Rules not processed for user `a63dbec5093f4aea81280d4ad81c3b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:54.000591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.011067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.011907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.012253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.012517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.013360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.015321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33772b26-4ccf-4e73-b7ad-5d8980eb4b81 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.031513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 919/1851] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:54.033727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.035041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.036943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.071489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] MFA Rules not processed for user `c579d6909981454d96ae932fe85b6c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:54.072879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.103256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 933/1852] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:54.110421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.125467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab839105-dc52-448e-94a7-e8d2b16bf751 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.132433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.134185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.135105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.135564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] PATH_INFO: `/v3/projects/c964e62f649e475d80ead762874c4e97/users/12e9162285e9479a91b0e1aaa264e7c6/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.156919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c964e62f649e475d80ead762874c4e97, user_id=12e9162285e9479a91b0e1aaa264e7c6, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.159631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.170209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 920/1853] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:54.171571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.180488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 934/1854] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:54 2022] PUT /identity/v3/projects/c964e62f649e475d80ead762874c4e97/users/12e9162285e9479a91b0e1aaa264e7c6/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:54.182487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.185051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.188085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457c714-9428-43f0-a9fc-88ee61a1cf20 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.243766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:54.249307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a487d2-9ddd-494b-837a-303758c1525f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.257678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.258983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.259260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.259638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.264385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.265187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.265526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.265804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.266572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.268242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.282311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 921/1855] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:54.282311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.295188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e4c1-dd0e-484e-9609-83a03c759963 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.301139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.301817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.302099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.302378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.303611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.306672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3779f-4381-4e3f-8e78-b55931c0d740 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.330327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.331985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.340144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 922/1856] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:54.341730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.342173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.342601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.345264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 935/1857] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:54.346214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.357939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22e62-c5e3-497a-97a3-d2215941daa6 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.380480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] MFA Rules not processed for user `12e9162285e9479a91b0e1aaa264e7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:54.381958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.404691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:54.430713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.431903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.432356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.432845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] PATH_INFO: `/v3/projects/ba1cb55b3ccd4340a987e2b9782e411d/users/91616faf3d0f4078a13b4b1d94c0a9cc/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.451250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1cb55b3ccd4340a987e2b9782e411d, user_id=91616faf3d0f4078a13b4b1d94c0a9cc, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.454310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.455765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 923/1858] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:54.457084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.468965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691d82a-8392-45c8-9524-7b3a6f7ee5d7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.471212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 936/1859] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:54 2022] PUT /identity/v3/projects/ba1cb55b3ccd4340a987e2b9782e411d/users/91616faf3d0f4078a13b4b1d94c0a9cc/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:54.472264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.482123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.543550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.544403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.544690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.544967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.545992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.547960 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988cc5-b00b-41f7-aa5a-70cfddf689fc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.548745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.552900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.553792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.554178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.554556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.557162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.578520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 924/1860] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/users => generated 308 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:54.583207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.602799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993053-f94f-4242-921d-c3eedc657a18 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.614662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:54.616861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.617986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.617986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.618158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.618825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.624001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.649405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.651134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bc38a-5fed-4e01-a072-f265b8b093a3 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.665212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 937/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:54.665212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.665212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.665661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.666717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 925/1862] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:54.667822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.702244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] MFA Rules not processed for user `91616faf3d0f4078a13b4b1d94c0a9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:54.708030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:54.765762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb4426-740c-4d36-8a5d-a64d94e3bacd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.779486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.785981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.786279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.786701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.787810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.789906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.801167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 938/1863] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:54.802084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.806226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 926/1864] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:54.807225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.815280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2e28-9abc-4ec0-88ab-e22f563dfe47 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.820307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144deea8-70bb-4d40-96e8-ac25fdd838bc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.822584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.823468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.823760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.824040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.824741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.826816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.829747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.830699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.831452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.831937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.833643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.835981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.858562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 939/1865] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:54.858562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.871556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27024d2b-6299-495c-8d9d-01d03dcfe308 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:54.878403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:54.879496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:54.881658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:54.882081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] PATH_INFO: `/v3/projects/2784eef6ac874fa2927d3a588316236b/users/ca2bffb44b264def8584181bffb6b61e/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:54.888436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 927/1866] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:54.888436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:54.896238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:54.911836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2784eef6ac874fa2927d3a588316236b, user_id=ca2bffb44b264def8584181bffb6b61e, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:54.915129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:54.959051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 940/1867] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:54 2022] PUT /identity/v3/projects/2784eef6ac874fa2927d3a588316236b/users/ca2bffb44b264def8584181bffb6b61e/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:54.959051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.016060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ecc5f-f627-480b-83d4-2d513e073892 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.129204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c05a4-a6fa-4381-9c97-2e1f0d4579d4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.136870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.138353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.138639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.138918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.141015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.143972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.151725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.152728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.153794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.154680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.156231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.158680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.180242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 928/1868] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:55.180242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.203142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d5acf-4eb3-49f4-875b-d61771ac848e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.204350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 941/1869] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:54 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:55.206849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.218462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.219249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.219623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.220012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.220944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.222828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.245937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4759d-1b27-4f38-8e04-9205db573af8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.249148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 929/1870] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:55.250146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.258966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.260024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.260382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.261312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] PATH_INFO: `/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1/users/ddcc5d5eae7040c4a7f462740a045953/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.274574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5648b5-8e99-480e-ab32-8a6ee4557b86 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.289390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:55.296574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.297532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.298004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.298341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.298506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb5f949554f48a9b6bb6f64a56995a1, user_id=ddcc5d5eae7040c4a7f462740a045953, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.300204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.302332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.305865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.324120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 942/1871] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:55 2022] PUT /identity/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1/users/ddcc5d5eae7040c4a7f462740a045953/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:55.325173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.330586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 930/1872] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:55.331679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.344206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3968-2bd0-4f8e-bf62-de177cc44a9c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.417594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b455-04b6-4f9a-9baa-8e24c8b6e475 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.424323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.425477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.425949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.426317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] PATH_INFO: `/v3/projects/2784eef6ac874fa2927d3a588316236b/users/ca2bffb44b264def8584181bffb6b61e/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.428953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2784eef6ac874fa2927d3a588316236b, user_id=ca2bffb44b264def8584181bffb6b61e, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.432380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.437380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.438413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.438850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.439849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.441140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.444050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177dc7-a8c5-47c3-aca4-586fcf681413 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.447189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 943/1873] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:55 2022] PUT /identity/v3/projects/2784eef6ac874fa2927d3a588316236b/users/ca2bffb44b264def8584181bffb6b61e/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:55.448498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.470402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 931/1874] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:55.471977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.472512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.472891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.520541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] MFA Rules not processed for user `ca2bffb44b264def8584181bffb6b61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:55.522997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:55.528927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc18d-6c23-4eee-bd48-4b0995fe40d8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.534087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.534807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.535090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.535432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] PATH_INFO: `/v3/projects/c6e0b454ab1845769075117838a11ebd/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.537911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:55.562869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e0b454ab1845769075117838a11ebd, user_id=af5acbd5dfe444c6a8ce3e2c5a5f28e9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.569522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.588254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 944/1875] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:55 2022] PUT /identity/v3/projects/c6e0b454ab1845769075117838a11ebd/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:55.589172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.648658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 932/1876] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:55.651920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.665932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1186-91a9-499e-8e5e-1e8325b78811 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.681349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a75331-a02e-44df-8a5b-91d1d64669ab admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.707660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.708829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.709595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.709866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] PATH_INFO: `/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1/users/ddcc5d5eae7040c4a7f462740a045953/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.714303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb5f949554f48a9b6bb6f64a56995a1, user_id=ddcc5d5eae7040c4a7f462740a045953, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.718736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.729989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:55.749231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 945/1877] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:55 2022] PUT /identity/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1/users/ddcc5d5eae7040c4a7f462740a045953/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:55.751137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.790303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.791016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.794210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.794543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.796335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.801258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5897-0d99-40c3-af80-02c610c7dec1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.817232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 933/1878] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:39:55.818474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.818763 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.819047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.837155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00588015-f2e8-400f-a9df-15d1efd6c032 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.841094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.841858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.842221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.842603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:55.851077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] MFA Rules not processed for user `ddcc5d5eae7040c4a7f462740a045953`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:55.852378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:55.920948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:55.922938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:55.940712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 934/1879] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:55.944992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.945885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 946/1880] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:55.963780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:55.980999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de5c7-2621-4cbb-bff7-cbcc7abeb01a service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:55.996656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:55.997390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:55.997682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:55.998006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.012926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:56.016979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.018602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eae88-c822-43ba-bc07-998638661b56 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.034527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 947/1881] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:56.074731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b5373-03f1-4983-b4e2-d33f32303d27 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:56.094085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:56.099404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.099852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.100171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] PATH_INFO: `/v3/projects/c6e0b454ab1845769075117838a11ebd/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.104526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e0b454ab1845769075117838a11ebd, user_id=af5acbd5dfe444c6a8ce3e2c5a5f28e9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.113588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.142531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 935/1882] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:39:55 2022] PUT /identity/v3/projects/c6e0b454ab1845769075117838a11ebd/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:56.152633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.152997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.153277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.184042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:56.215470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] MFA Rules not processed for user `af5acbd5dfe444c6a8ce3e2c5a5f28e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:56.216726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.392875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238ce6-b27b-48ad-853c-6ee53f2deaac admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:56.413843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:56.415490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.415928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.416218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] PATH_INFO: `/v3/users/c579d6909981454d96ae932fe85b6c05` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.417524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c579d6909981454d96ae932fe85b6c05)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.419527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.445811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 948/1883] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:56.480421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:56.509105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c579d6909981454d96ae932fe85b6c05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:56.518744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:56.528371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c579d6909981454d96ae932fe85b6c05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:56.551145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c579d6909981454d96ae932fe85b6c05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:56.552136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c579d6909981454d96ae932fe85b6c05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:56.567790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ee9d-eefc-4ebb-800d-85657818125e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:56.573621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7d03af56-9000-46da-91a0-91943fc75a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c579d6909981454d96ae932fe85b6c05'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:56.575018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:56.576125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.578431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.579288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.581976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.585305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 936/1884] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:56 2022] DELETE /identity/v3/users/c579d6909981454d96ae932fe85b6c05 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:56.587084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.601005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.601510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.602698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.604686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.625829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 949/1885] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:56.629074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:56.636228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.685445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:56.721938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 937/1886] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:56.731292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:56.732624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:56.733058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.734052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.746564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8200-e754-46b6-b7d1-1875104be82c service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:56.810910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955f2c-3e0d-446f-9ea5-b0f47eec333e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:56.811164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:56.812166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.812594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.812879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.814905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:56.815049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:56.815445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:56.815725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:56.816078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:56.826423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.832908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.848873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 938/1887] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:56.903719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:56.905569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad66b54-fd40-443a-a461-c95cd60db562 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:56.917319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 950/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:57.201505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:57.203190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:57.219128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd9a5-4a55-4e6e-8814-df0fef80e38b service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:57.226557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:57.227985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:57.228426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:57.228948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] PATH_INFO: `/v3/users/12e9162285e9479a91b0e1aaa264e7c6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:57.231597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e9162285e9479a91b0e1aaa264e7c6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:57.234659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:57.295325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e9162285e9479a91b0e1aaa264e7c6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.310094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e9162285e9479a91b0e1aaa264e7c6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.330873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e9162285e9479a91b0e1aaa264e7c6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.332070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e9162285e9479a91b0e1aaa264e7c6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.365231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e9162285e9479a91b0e1aaa264e7c6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.379320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 939/1889] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:57 2022] DELETE /identity/v3/users/12e9162285e9479a91b0e1aaa264e7c6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:57.385170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:57.385784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:57.386050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:57.425182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:57.429021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:57.589414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 951/1890] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:57.611176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:57.613144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:57.726402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:57.728016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:57.731227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877a6bc-6cf1-4896-8d70-f6fddbc4d95a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:57.742749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:57.743206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622957e-e51f-46b7-865f-a1fb02949168 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:57.743466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:57.744008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:57.744292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:57.750607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:57.751714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:57.752613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:57.752907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] PATH_INFO: `/v3/projects/ac0f2637ee4741cc81a4e7ae02f747b6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:57.754320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0f2637ee4741cc81a4e7ae02f747b6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:57.756849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:57.779740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:57.793624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:57.803559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:57.804169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:57.818944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 940/1891] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:57.882021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0f2637ee4741cc81a4e7ae02f747b6', 'request_id': 'req-faf3d0f5-9288-4a72-a826-940d0028b371'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.889299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0f2637ee4741cc81a4e7ae02f747b6', 'request_id': 'req-faf3d0f5-9288-4a72-a826-940d0028b371'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.897597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0f2637ee4741cc81a4e7ae02f747b6', 'request_id': 'req-faf3d0f5-9288-4a72-a826-940d0028b371'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.920102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] The token cache is being invalidate because project ac0f2637ee4741cc81a4e7ae02f747b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:57.920591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.922079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-faf3d0f5-9288-4a72-a826-940d0028b371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:57.927548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 952/1892] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:57 2022] DELETE /identity/v3/projects/ac0f2637ee4741cc81a4e7ae02f747b6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:57.928375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:57.944908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0801c-baae-40ac-8b00-867c205eca1e service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:58.088109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:58.089512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.090920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.091203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] PATH_INFO: `/v3/users/ca2bffb44b264def8584181bffb6b61e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.096731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2bffb44b264def8584181bffb6b61e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:58.099255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:58.110355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de7f-def7-402d-b75c-f1a96eaa5d74 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.110649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de7f-def7-402d-b75c-f1a96eaa5d74 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.110935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de7f-def7-402d-b75c-f1a96eaa5d74 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.113348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 953/1893] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:58.129107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.129394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.129678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.163532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:58.165621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:58.214063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2bffb44b264def8584181bffb6b61e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.232773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2bffb44b264def8584181bffb6b61e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.250358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2bffb44b264def8584181bffb6b61e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.251173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2bffb44b264def8584181bffb6b61e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.277357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2bffb44b264def8584181bffb6b61e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.292880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 941/1894] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:57 2022] DELETE /identity/v3/users/ca2bffb44b264def8584181bffb6b61e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:39:58.347255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 954/1895] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:58.383657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:58.385767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:58.426095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:58.432324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:58.455437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946c56-7d43-406b-84ae-6cca59fadd5a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:58.536581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254e25-7580-473b-850c-cbdc79b4eb4c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:58.552157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:58.554935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.555579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.556572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.566586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:58.567616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.567964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.568313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] PATH_INFO: `/v3/users/de9050cdfc2d4109ac9a5d624d26bae4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.569630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9050cdfc2d4109ac9a5d624d26bae4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:58.572242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:58.585441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:58.590505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29485-f4b4-43e7-afa0-e448afa7c908 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:58.619779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 942/1896] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:58.637812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:58.661373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9050cdfc2d4109ac9a5d624d26bae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.671489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9050cdfc2d4109ac9a5d624d26bae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.672326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9050cdfc2d4109ac9a5d624d26bae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.687755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9050cdfc2d4109ac9a5d624d26bae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.688437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9050cdfc2d4109ac9a5d624d26bae4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:58.727086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 955/1897] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:58 2022] DELETE /identity/v3/users/de9050cdfc2d4109ac9a5d624d26bae4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:58.732481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:58.732832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:58.733247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:58.743050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:58.778901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:58.780180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:58.913461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 943/1898] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:58.955962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:58.957669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.065819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.067497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.096343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f238d46-4718-4d11-8cb3-9b11f54126f7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.100027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d587fc-1f42-48bc-89dd-a6d157c2c002 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.106729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.107698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.108589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.108866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.109136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] PATH_INFO: `/v3/projects/2784eef6ac874fa2927d3a588316236b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.109869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.110139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.110402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.112918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2784eef6ac874fa2927d3a588316236b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.114859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.135948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.138486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.152302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 956/1899] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:59.153265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.157370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.172636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4517-4859-49bf-b576-00c7c0e2e8dd service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.178504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.179586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.179873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.180144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] PATH_INFO: `/v3/projects/c964e62f649e475d80ead762874c4e97` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.181558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c964e62f649e475d80ead762874c4e97)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.184128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.253556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2784eef6ac874fa2927d3a588316236b', 'request_id': 'req-f57cd5e1-f66e-4e39-941d-fb52472d3069'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.266159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2784eef6ac874fa2927d3a588316236b', 'request_id': 'req-f57cd5e1-f66e-4e39-941d-fb52472d3069'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.273108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2784eef6ac874fa2927d3a588316236b', 'request_id': 'req-f57cd5e1-f66e-4e39-941d-fb52472d3069'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.302610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] The token cache is being invalidate because project 2784eef6ac874fa2927d3a588316236b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:59.303692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.303906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c964e62f649e475d80ead762874c4e97', 'request_id': 'req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.305013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f57cd5e1-f66e-4e39-941d-fb52472d3069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.310838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 944/1900] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:59 2022] DELETE /identity/v3/projects/2784eef6ac874fa2927d3a588316236b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:59.318526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2498-e56c-49e9-825c-696a66c68b94 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.319564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2498-e56c-49e9-825c-696a66c68b94 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.319915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2498-e56c-49e9-825c-696a66c68b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.320654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c964e62f649e475d80ead762874c4e97', 'request_id': 'req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.330207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c964e62f649e475d80ead762874c4e97', 'request_id': 'req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.346404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6fca2498-e56c-49e9-825c-696a66c68b94 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:59.347882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6fca2498-e56c-49e9-825c-696a66c68b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.350571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] The token cache is being invalidate because project c964e62f649e475d80ead762874c4e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:59.351176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.352680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.355003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 957/1901] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:59 2022] DELETE /identity/v3/projects/c964e62f649e475d80ead762874c4e97 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:59.359202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.361882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.423842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:59.479381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeeb5a-3c27-49a5-a9a7-d12a3620f7fe admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.485075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.486460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.486744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.487602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] PATH_INFO: `/v3/users/ddcc5d5eae7040c4a7f462740a045953` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.490619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcc5d5eae7040c4a7f462740a045953)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.494630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.513889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 945/1902] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:59.522077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.522606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.523255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.569097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:59.574680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcc5d5eae7040c4a7f462740a045953'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.576377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.591699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcc5d5eae7040c4a7f462740a045953'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.593133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcc5d5eae7040c4a7f462740a045953'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.597633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 946/1903] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:59.602335 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.613091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcc5d5eae7040c4a7f462740a045953'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.613730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcc5d5eae7040c4a7f462740a045953'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.621908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a139f3-5016-4a85-abe8-fb7f1dbfba92 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.628813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.629684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.629964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.630238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.631189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:39:59.631980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.634320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.649166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 958/1904] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:39:59 2022] DELETE /identity/v3/users/ddcc5d5eae7040c4a7f462740a045953 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:39:59.652224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 947/1905] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:39:59.655217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.658130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.701378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.703817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:59.734178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16f77-30d4-4b38-ac9c-799bf55002b0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.745553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:59.785020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6a75-7910-4e5d-a296-342dfb512189 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.790764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.793516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.793803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.794091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.794982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.796867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.831315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 959/1906] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:39:59 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:39:59.836744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:59.881788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:59.883369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:59.883369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:59.883595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] PATH_INFO: `/v3/projects/d0379e59550245f6b75828db6adb06cb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:59.884863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0379e59550245f6b75828db6adb06cb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:59.887298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:59.905211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:59.946895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446aa4-f32b-40e2-bbce-f7ba779baa99 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:59.962403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0379e59550245f6b75828db6adb06cb', 'request_id': 'req-e7f50e35-013d-41a9-9a78-e21e0c9b5666'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.971085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0379e59550245f6b75828db6adb06cb', 'request_id': 'req-e7f50e35-013d-41a9-9a78-e21e0c9b5666'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.977585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0379e59550245f6b75828db6adb06cb', 'request_id': 'req-e7f50e35-013d-41a9-9a78-e21e0c9b5666'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.996339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] The token cache is being invalidate because project d0379e59550245f6b75828db6adb06cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:39:59.997102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:39:59.997594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.000491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 948/1907] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:39:59 2022] DELETE /identity/v3/projects/d0379e59550245f6b75828db6adb06cb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:00.004820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.006238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.028659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.029640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.030165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.030594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.031507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.033937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.083140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 960/1908] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:39:59 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:00.088267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.093314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.125177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149dd34-1b43-4a78-bf3a-c31813a6e109 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.145159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.146775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.147053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.147353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.148097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.149718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.194203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f50e35-013d-41a9-9a78-e21e0c9b5666 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.214514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.215969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.216837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.217301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] PATH_INFO: `/v3/users/c5bea114e65c484182f7fbedc39c0783` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.219300 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bea114e65c484182f7fbedc39c0783)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.221627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 961/1909] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:00.225445 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.225876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.248082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64602-0cd2-4b06-8105-34e703af3513 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.262240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.262944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.263224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.265995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.266775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.268497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.280791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 962/1910] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:40:00.284920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.300265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d2ac-32a4-417c-bed3-d035de64e570 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.307545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.312011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.315518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:00.315972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.318270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] PATH_INFO: `/v3/projects/83cc8b9844a348d1b182d43ccdd33bf7/users/af379dc0045d4dc6bb7d68137f428e80/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.329311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bea114e65c484182f7fbedc39c0783'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.349088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bea114e65c484182f7fbedc39c0783'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.357262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc8b9844a348d1b182d43ccdd33bf7, user_id=af379dc0045d4dc6bb7d68137f428e80, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.360263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.369563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bea114e65c484182f7fbedc39c0783'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.370221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bea114e65c484182f7fbedc39c0783'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.389339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-164e0c1d-b67b-4f7a-bdc6-a35451f8d5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bea114e65c484182f7fbedc39c0783'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.404869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 949/1911] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:00 2022] DELETE /identity/v3/users/c5bea114e65c484182f7fbedc39c0783 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:00.405714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 963/1912] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:00 2022] PUT /identity/v3/projects/83cc8b9844a348d1b182d43ccdd33bf7/users/af379dc0045d4dc6bb7d68137f428e80/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:00.418830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.419113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.419436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.477352 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.479307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.491408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] MFA Rules not processed for user `af379dc0045d4dc6bb7d68137f428e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:00.495581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.632152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99d33-d7fa-4bd3-bdcf-8aac569ac278 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.672843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 950/1913] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:00.673795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.677896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.737126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:00.789077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.791830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.794631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.794938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] PATH_INFO: `/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.803812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb5f949554f48a9b6bb6f64a56995a1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.823836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.886887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd9102-ab25-42a9-b6a8-0c5716b78d8b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:00.898961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:00.900194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.900504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.900788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.901510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:00.909591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:00.913923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb5f949554f48a9b6bb6f64a56995a1', 'request_id': 'req-38e7f614-6dae-4b3e-a498-9c685b877f7a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.921189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb5f949554f48a9b6bb6f64a56995a1', 'request_id': 'req-38e7f614-6dae-4b3e-a498-9c685b877f7a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.947851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb5f949554f48a9b6bb6f64a56995a1', 'request_id': 'req-38e7f614-6dae-4b3e-a498-9c685b877f7a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.973932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 951/1914] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:00 2022] POST /identity/v3/projects => generated 371 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:00.974984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.975325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] The token cache is being invalidate because project ccb5f949554f48a9b6bb6f64a56995a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:00.975612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.976477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:00.976918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.978145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 964/1915] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:00 2022] DELETE /identity/v3/projects/ccb5f949554f48a9b6bb6f64a56995a1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:00.979848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:00.988166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.056169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:01.081800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f614-6dae-4b3e-a498-9c685b877f7a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.097006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a9e4-081c-4e0f-8ff1-dee4e04352f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.102798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.103516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.107387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.107387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] PATH_INFO: `/v3/projects/a8bbea5414e24fbe9ded028c7b03df85` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.107387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8bbea5414e24fbe9ded028c7b03df85)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.107766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.163579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.164262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.164541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.164815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.165505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.167652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b97068-63d2-45b0-ba78-6e740aa76f9b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.172794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8bbea5414e24fbe9ded028c7b03df85', 'request_id': 'req-69139423-fcb6-42ec-994d-b12a4821252e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.181098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8bbea5414e24fbe9ded028c7b03df85', 'request_id': 'req-69139423-fcb6-42ec-994d-b12a4821252e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.190333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 965/1916] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:00 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:01.191728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.191970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8bbea5414e24fbe9ded028c7b03df85', 'request_id': 'req-69139423-fcb6-42ec-994d-b12a4821252e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.192090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.192290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.205155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] The token cache is being invalidate because project a8bbea5414e24fbe9ded028c7b03df85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:01.205454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.206169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.207796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 952/1917] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:00 2022] DELETE /identity/v3/projects/a8bbea5414e24fbe9ded028c7b03df85 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:01.208561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.212038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.212171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:01.213353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.219691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:01.279258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69139423-fcb6-42ec-994d-b12a4821252e admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.284259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.284679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 966/1918] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:01.285438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.285700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.285799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.285981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.286716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.287037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.288433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a821f-5b14-4d03-b5d6-efba91fcaf24 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.299690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 953/1919] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:01.299827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884dcd-ea4f-4152-92ed-0bf27f11daa5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.301091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.301388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.301678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.305170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.306061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.306344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.306754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] PATH_INFO: `/v3/users/a63dbec5093f4aea81280d4ad81c3b49` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.308142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63dbec5093f4aea81280d4ad81c3b49)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.311587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.321233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:01.322527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.331025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 954/1920] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:01.331863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.342347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee2d5-d4f3-4edd-9ca4-1f5bb234e829 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.349291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.350292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.350614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.350929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] PATH_INFO: `/v3/projects/e4b911355e41401c97200e90ed0cb94e/users/762aff1f63a34e93a5e8b1226bb34e25/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.368347 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b911355e41401c97200e90ed0cb94e, user_id=762aff1f63a34e93a5e8b1226bb34e25, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.370187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63dbec5093f4aea81280d4ad81c3b49'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.371240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.377644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63dbec5093f4aea81280d4ad81c3b49'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.378349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63dbec5093f4aea81280d4ad81c3b49'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.385416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 955/1921] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:01 2022] PUT /identity/v3/projects/e4b911355e41401c97200e90ed0cb94e/users/762aff1f63a34e93a5e8b1226bb34e25/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:01.385933 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63dbec5093f4aea81280d4ad81c3b49'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.386389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.386565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63dbec5093f4aea81280d4ad81c3b49'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.388057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.406042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 967/1922] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:01 2022] DELETE /identity/v3/users/a63dbec5093f4aea81280d4ad81c3b49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:01.407110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.408675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.424302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:01.465772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb6d7-a2b6-4fc6-8db4-97f7865266d0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.479075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc959-ebdc-4d78-bec7-d28ec7c5e778 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.485258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.486467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.486947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.487418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.489105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.491600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.505439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 968/1923] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:01.509544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.521131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c0fa8-7212-49e6-aa64-9f28339e8a94 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.526209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.526758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.527035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.527419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] PATH_INFO: `/v3/projects/e4b911355e41401c97200e90ed0cb94e/users/762aff1f63a34e93a5e8b1226bb34e25/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.529429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b911355e41401c97200e90ed0cb94e, user_id=762aff1f63a34e93a5e8b1226bb34e25, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.532125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.533308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.533708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.533991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.534385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.535034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:01.535371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.537008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94c4e-462f-4d79-9f25-ba1c48015734 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.547164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 969/1924] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:01 2022] PUT /identity/v3/projects/e4b911355e41401c97200e90ed0cb94e/users/762aff1f63a34e93a5e8b1226bb34e25/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:01.554851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 956/1925] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:01.557169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.557652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.557942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.558222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.564485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:01.604584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] MFA Rules not processed for user `762aff1f63a34e93a5e8b1226bb34e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:01.605835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.650408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a08-b158-4784-9882-728380a5816b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.656432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.657099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.657381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.658053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.658757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.661058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.694645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 970/1926] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:01.695298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 957/1927] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:01.703946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.704094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.705531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.782593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbaa0e-df91-4323-969d-a9d7b6330a39 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.788884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb64-fd43-438f-b764-fa6477037d1c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.789564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:01.798971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.799822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.800334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.800830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.801569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.804188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.844093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 971/1928] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:01.845062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.848281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:01.866055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff559-c888-41a8-9ca0-9f557a3bc246 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.872115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.873239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.873527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.873874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] PATH_INFO: `/v3/projects/d2464731bd804c46ba438530c6183afc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.875308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2464731bd804c46ba438530c6183afc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.877336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.878959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:01.879824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.880107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.880694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.943227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2464731bd804c46ba438530c6183afc', 'request_id': 'req-4d8d8c00-ff7a-45da-951e-7870d5551c32'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.948353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:01.949846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2464731bd804c46ba438530c6183afc', 'request_id': 'req-4d8d8c00-ff7a-45da-951e-7870d5551c32'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.950080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:01.957125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2464731bd804c46ba438530c6183afc', 'request_id': 'req-4d8d8c00-ff7a-45da-951e-7870d5551c32'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.960508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 958/1929] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:01.961502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:01.972704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a241-ab69-44ff-8509-8600f0cbe74f service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:01.973692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] The token cache is being invalidate because project d2464731bd804c46ba438530c6183afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:01.974204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.975053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4d8d8c00-ff7a-45da-951e-7870d5551c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:01.976785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 972/1930] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:01 2022] DELETE /identity/v3/projects/d2464731bd804c46ba438530c6183afc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:01.982729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:01.983198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:01.983555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:01.992081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.007796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.010201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.047722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.048503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.048854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.049254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.050055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.051817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.064688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 959/1931] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:02.065681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.067692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.080347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 973/1932] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:02.081212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.082451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.097837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08c3c7-c90b-4cc9-81cf-526463b0fa0f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.103782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.104605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.104889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.105166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.106093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.108549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f9f4e-de34-4e84-ae25-33b86812b427 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.123077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 974/1933] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:02.123077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.123077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.123077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.135428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9018-0ee1-4d3e-b82c-87a3133a6294 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.140512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.140912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.141451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.141728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.141996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.142129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.143833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.150277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 975/1934] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:02.151025 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.158870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.160961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad2849-96d5-4caa-8d2b-50274d959143 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.166120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.167009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.167450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.167748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] PATH_INFO: `/v3/projects/61704ca38a8e48a8bf80d50b47eb2343/users/1e8acfe8749d4274b1c8de3148b4618a/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.185661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61704ca38a8e48a8bf80d50b47eb2343, user_id=1e8acfe8749d4274b1c8de3148b4618a, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.188582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.212528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 976/1935] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:02 2022] PUT /identity/v3/projects/61704ca38a8e48a8bf80d50b47eb2343/users/1e8acfe8749d4274b1c8de3148b4618a/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:02.213586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.227836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.229476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7ad7e-75af-4e04-98bf-c9b4136652a2 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.239721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 960/1936] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:02.241045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.241337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.241617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.268910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] MFA Rules not processed for user `1e8acfe8749d4274b1c8de3148b4618a`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.270309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.319006 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3551a2-4ee8-4b4f-a43e-fe8e1c590995 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.325570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.326392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.326676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.327118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.328103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:02.328334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.330048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.354587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 977/1937] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:02.355587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.358717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 961/1938] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:02.366889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308bbf-8ec9-42e1-a9f3-3f2adf910404 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.370507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.372147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.372513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.372811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.373097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.373375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.374073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.376787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.427144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 978/1939] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:02.428513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.457363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdcfb7-7fce-49cc-9859-edec1f9ce1e7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.493580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.518514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.519265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.519649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.519990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.530699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec12-1151-49dc-bb8c-0feb7c306ef5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.531640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.537152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.537833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.538112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.538382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.539080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.541104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.568664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 979/1940] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:02.572890 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.583290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0a00-1eb7-4cc8-8299-317ebac2df0a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.587818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.588202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.588860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.589139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.589289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.589418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.590161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.591779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.598659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 962/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:02.601997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 980/1942] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:40:02.606037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.617484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecce61-de48-4a7b-8306-a8c5e54f80b0 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.617931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.623128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.623856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.624181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.624462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.625187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.626809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.628429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dbaf-f23a-441b-8cd8-0b41585d7144 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.633841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.634722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.635005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.635283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] PATH_INFO: `/v3/users/1e8acfe8749d4274b1c8de3148b4618a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.636610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8acfe8749d4274b1c8de3148b4618a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.637552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 963/1943] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:02.639843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.641653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.652175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef848-ca80-4c5b-8b20-678653a30d3b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.657593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.658490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.658773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.659051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] PATH_INFO: `/v3/projects/9091e75ed19745d1ac8d49ad6d26aaaf/users/577f1fffd30345eaa4391cff95d13dfd/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.675109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9091e75ed19745d1ac8d49ad6d26aaaf, user_id=577f1fffd30345eaa4391cff95d13dfd, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.677855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28fcd-9e5a-4eba-8ef2-73e65192d270 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.688688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8acfe8749d4274b1c8de3148b4618a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:02.690887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 964/1944] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:02 2022] PUT /identity/v3/projects/9091e75ed19745d1ac8d49ad6d26aaaf/users/577f1fffd30345eaa4391cff95d13dfd/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:02.703031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.703626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.703782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.704987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8acfe8749d4274b1c8de3148b4618a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:02.705787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8acfe8749d4274b1c8de3148b4618a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:02.714357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8acfe8749d4274b1c8de3148b4618a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:02.715078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7e446eb7-fe80-4670-b332-aa6dddc0c43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8acfe8749d4274b1c8de3148b4618a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:02.731868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] MFA Rules not processed for user `577f1fffd30345eaa4391cff95d13dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.732800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 981/1945] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:02 2022] DELETE /identity/v3/users/1e8acfe8749d4274b1c8de3148b4618a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:02.733211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.737291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.737587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.738002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.756615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.757848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.804974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 965/1946] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:02.806083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.807447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.818427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 982/1947] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:02.828248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.829695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.861600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.878609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f037096-d28f-46a3-860b-4554c6302555 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.883537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.884206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.884491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.884769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.885463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.887476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.896694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:02.896856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851d77e-80d1-4250-8a91-18ee5aee8746 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.901058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.901719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.902003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.902342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.913395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.915320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.923053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 966/1948] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:02.926889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.928365 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 983/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:02.992334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6dc11-9ef6-4984-838e-2b3c5b5a505f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.997305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.997987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.998272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.998549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.999255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.001234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.026203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 967/1950] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:03.027771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.038207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fbb6-858f-4583-8ace-f535bc8273b8 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.043078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.043829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.044114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.044411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.045127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.046779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.058138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 984/1951] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:03.062512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.073162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4142-ed33-4549-b449-76b83858cf23 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.078430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.079283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.079647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.080016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] PATH_INFO: `/v3/projects/5cc4672421184ab8a86e869a54ad7ff4/users/f7a881179262477284a09093e36fcd9f/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.098334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc4672421184ab8a86e869a54ad7ff4, user_id=f7a881179262477284a09093e36fcd9f, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.101164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.123756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 968/1952] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:03 2022] PUT /identity/v3/projects/5cc4672421184ab8a86e869a54ad7ff4/users/f7a881179262477284a09093e36fcd9f/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:03.127041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.137588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abaff-a778-414d-8224-f489f689dd51 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.209424 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.210104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.210389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.210667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.211763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.213381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1606ccb-2648-46a4-9b3d-2a1f8591976c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.225290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 985/1953] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:03.229000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.241699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78027eb-7b5b-4c04-82bb-4e70f60f53bc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.246339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.247267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.247583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.247855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] PATH_INFO: `/v3/projects/5cc4672421184ab8a86e869a54ad7ff4/users/f7a881179262477284a09093e36fcd9f/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.249829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc4672421184ab8a86e869a54ad7ff4, user_id=f7a881179262477284a09093e36fcd9f, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.252521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.262932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 969/1954] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:03 2022] PUT /identity/v3/projects/5cc4672421184ab8a86e869a54ad7ff4/users/f7a881179262477284a09093e36fcd9f/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:03.273161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.273455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.273741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.302394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] MFA Rules not processed for user `f7a881179262477284a09093e36fcd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:03.303636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.368314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.375710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.410508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 986/1955] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:03.417676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.419503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.462377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fd7e6-098e-443d-a07e-b1c7f23e9d92 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.468066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.468942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.469222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.469487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] PATH_INFO: `/v3/projects/61704ca38a8e48a8bf80d50b47eb2343` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.470670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61704ca38a8e48a8bf80d50b47eb2343)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.472622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.484699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:03.503094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd3b3-97c5-4a01-a958-ce8ac6607d07 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.508583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.509326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.509876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.510057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.521351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.522836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a06ca8-31d0-4692-975d-066dbcf7e64d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.533930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 987/1956] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:03.538117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:03.542534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61704ca38a8e48a8bf80d50b47eb2343', 'request_id': 'req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:03.558342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61704ca38a8e48a8bf80d50b47eb2343', 'request_id': 'req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:03.565826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61704ca38a8e48a8bf80d50b47eb2343', 'request_id': 'req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:03.593203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] The token cache is being invalidate because project 61704ca38a8e48a8bf80d50b47eb2343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:03.594024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:03.595397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-9d3239fc-1596-49c7-b0cc-b49a3506eb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:03.598154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 970/1957] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:03 2022] DELETE /identity/v3/projects/61704ca38a8e48a8bf80d50b47eb2343 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:03.603077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.603410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.603711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.627594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:03.629048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.723471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 988/1958] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:03.728345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.728764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.728915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.750336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:03.751654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.766148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 971/1959] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:03.770415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.783012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b8f4a-c337-437b-8ea8-351c4bf303ae None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.798657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.801116 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.801404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.803527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.804594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:03.804984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.807506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.829522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 989/1960] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:40:03.830281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.846779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ac5d4-bc6d-454c-9586-6cef0c1f6d00 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.856209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.857403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.857742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.858219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.859185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.861329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.903892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 972/1961] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:03.905507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.918350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91476a7a-7f5c-446f-b7ae-29a8ae0ee594 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.020534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.022376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.022668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.023250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.023997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.026854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.059728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.061720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.063200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 990/1962] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:04.064293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.074221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88c91-ca9c-4902-a7ca-b8d18a637378 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.074663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce110e-be1c-4d7d-8e8d-3528fc9b2709 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.078874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.079397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.079633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.079981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.080262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.080505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.080848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.081023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.081255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] PATH_INFO: `/v3/users/577f1fffd30345eaa4391cff95d13dfd` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.082514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] RBAC: Authorizing `identity:delete_user(user_id=577f1fffd30345eaa4391cff95d13dfd)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.082605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.085194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.097150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 991/1963] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:04.101689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.113710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4a7d-8c91-4d42-a6b5-b49e76e4d82c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.118374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.119045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.119327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.119631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.120728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.122853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.134246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 992/1964] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:40:04.138566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.147647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577f1fffd30345eaa4391cff95d13dfd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:04.148646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd677-cb98-477f-87a6-0dceb634b3a2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.154624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577f1fffd30345eaa4391cff95d13dfd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:04.154794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.155811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.156093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.156441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] PATH_INFO: `/v3/projects/923be056c52649f29600839f943a0d14/users/ff949722ca9447c8b21c0301346e7b85/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.166871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577f1fffd30345eaa4391cff95d13dfd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:04.167711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577f1fffd30345eaa4391cff95d13dfd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:04.173474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923be056c52649f29600839f943a0d14, user_id=ff949722ca9447c8b21c0301346e7b85, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.178430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53be44-91e0-46fd-ba90-57e6715c8235 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.182409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ef89f73-62d5-49f2-b6f6-c5b7e1e0300e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577f1fffd30345eaa4391cff95d13dfd'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:04.198765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 973/1965] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:04 2022] DELETE /identity/v3/users/577f1fffd30345eaa4391cff95d13dfd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:04.201126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 993/1966] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:04 2022] PUT /identity/v3/projects/923be056c52649f29600839f943a0d14/users/ff949722ca9447c8b21c0301346e7b85/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:04.203243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.203599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.203881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.211507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.215653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.215965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.237069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:04.238699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:04.240106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.246773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] MFA Rules not processed for user `ff949722ca9447c8b21c0301346e7b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:04.248681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.302466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 974/1967] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:04.321136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.322662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.328475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 994/1968] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:04.332964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.334260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.346318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:04.348361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495220-ddb9-4272-8226-ef28dc02b954 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.353377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.354049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.354324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.354594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.355283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.357273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.393745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 995/1969] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:04.395316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.397140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00075e-07c5-48eb-83cf-3b1e857697f7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.455784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.456443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.456726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.456995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.486120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be695a-81fe-4915-8c74-79e56a143950 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.491290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.492051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.492289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.492561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.493257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.495242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.520678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 996/1970] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:04.521700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.531478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ffc9-e376-4c79-abdd-2511f4628bf0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.535237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.536764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.536887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.537430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.537854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.538185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.538917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.540620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.549605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 975/1971] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:04.554309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 997/1972] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:04.555080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.565642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868038-2f60-4f44-beb0-10acc709e922 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.570965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.572243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.572732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.573155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] PATH_INFO: `/v3/projects/00cb0e91aed64b7d8783874cc52def37/users/639e2f13cc784030ad1fef5d0cd28936/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.591507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cb0e91aed64b7d8783874cc52def37, user_id=639e2f13cc784030ad1fef5d0cd28936, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.594942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.619128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 976/1973] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:04 2022] PUT /identity/v3/projects/00cb0e91aed64b7d8783874cc52def37/users/639e2f13cc784030ad1fef5d0cd28936/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:04.620145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.634812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d3a27-5c29-4845-aaac-b94d05c5b19e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.714134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:04.722768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.723904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.725086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.725438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.726383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.729524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea544e3-2548-4e3a-b70a-65caae943ecf admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.745789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 998/1974] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:04.749808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:04.762513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fff999-a5ca-4516-92bf-432df5ce37c6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:04.767915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:04.769030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.769835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.770298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] PATH_INFO: `/v3/projects/00cb0e91aed64b7d8783874cc52def37/users/639e2f13cc784030ad1fef5d0cd28936/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.780619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cb0e91aed64b7d8783874cc52def37, user_id=639e2f13cc784030ad1fef5d0cd28936, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:04.784727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:04.823209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 977/1975] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:04 2022] PUT /identity/v3/projects/00cb0e91aed64b7d8783874cc52def37/users/639e2f13cc784030ad1fef5d0cd28936/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:04.834551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.834808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.835090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.888041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] MFA Rules not processed for user `639e2f13cc784030ad1fef5d0cd28936`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:04.890327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.083000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.083000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.102476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 999/1976] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:05.121559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.124017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.159194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:05.184433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721068-cd26-49a6-af1d-b5fbf9aa8256 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:05.191421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:05.192319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.192606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.192944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] PATH_INFO: `/v3/projects/9091e75ed19745d1ac8d49ad6d26aaaf` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.194232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9091e75ed19745d1ac8d49ad6d26aaaf)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:05.196232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:05.223897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdd5f4-05ec-4c94-8b6a-eee403f6a6e8 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:05.228852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:05.229627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.229777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.230050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.286599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9091e75ed19745d1ac8d49ad6d26aaaf', 'request_id': 'req-cedcec65-897c-4fb2-841d-4aff9ccfda31'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.298512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9091e75ed19745d1ac8d49ad6d26aaaf', 'request_id': 'req-cedcec65-897c-4fb2-841d-4aff9ccfda31'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.303244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:05.305152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:05.306387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9091e75ed19745d1ac8d49ad6d26aaaf', 'request_id': 'req-cedcec65-897c-4fb2-841d-4aff9ccfda31'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.317428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1000/1977] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:05.320893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] The token cache is being invalidate because project 9091e75ed19745d1ac8d49ad6d26aaaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:05.321187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.321911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.323773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 978/1978] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:05 2022] DELETE /identity/v3/projects/9091e75ed19745d1ac8d49ad6d26aaaf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:05.328778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.344782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e9807-adb5-4804-b024-665b35053bfa service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:05.382543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:05.418029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:05.420074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.420827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.421360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] PATH_INFO: `/v3/users/f7a881179262477284a09093e36fcd9f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.423207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a881179262477284a09093e36fcd9f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:05.426703 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:05.503816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a881179262477284a09093e36fcd9f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.523153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a881179262477284a09093e36fcd9f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.524695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a881179262477284a09093e36fcd9f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.545638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a881179262477284a09093e36fcd9f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.547267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-70960347-0ab9-4fe5-b67b-d7645c4c45c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a881179262477284a09093e36fcd9f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:05.569051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1001/1979] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:05 2022] DELETE /identity/v3/users/f7a881179262477284a09093e36fcd9f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:05.935948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.937419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.950214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec65-897c-4fb2-841d-4aff9ccfda31 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.023891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.024776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.025066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.025357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] PATH_INFO: `/v3/projects/5cc4672421184ab8a86e869a54ad7ff4` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.026518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc4672421184ab8a86e869a54ad7ff4)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.028532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.080550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc4672421184ab8a86e869a54ad7ff4', 'request_id': 'req-c434d2ca-8a13-4313-9b3a-33453b9e4974'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:06.098328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc4672421184ab8a86e869a54ad7ff4', 'request_id': 'req-c434d2ca-8a13-4313-9b3a-33453b9e4974'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:06.108870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc4672421184ab8a86e869a54ad7ff4', 'request_id': 'req-c434d2ca-8a13-4313-9b3a-33453b9e4974'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:06.121444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] The token cache is being invalidate because project 5cc4672421184ab8a86e869a54ad7ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:06.122003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:06.123438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c434d2ca-8a13-4313-9b3a-33453b9e4974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:06.125380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 979/1980] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:05 2022] DELETE /identity/v3/projects/5cc4672421184ab8a86e869a54ad7ff4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:06.131722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.132223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.132302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.154300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:06.155536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:06.226534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1002/1981] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:06.235558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.235850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.236126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.244315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:06.257219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:06.258427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:06.266449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 980/1982] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:06.270735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.280428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896ec2-b5ca-4f12-bb42-3bccba8b0a86 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.284919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.285572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.285849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.286158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.286883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:06.287181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.288856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.300629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1003/1983] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:06.304990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.314652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4b3f-c2f0-4467-8be1-288f9877d0d0 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.320053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.320953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.321238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.321510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.322205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.324177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.351694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 981/1984] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:06 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:06.357441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.368093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40de89-39ec-4a77-b855-00965a6d1e3c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.406975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:06.429624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.429624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.429624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.429624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.430370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.432326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.457789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1004/1985] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:06 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:06.459054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.470039 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45fe1-4f28-444b-b746-840b2de2aa40 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.475451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.476333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.476659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.477020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.477782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.479415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.491730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 982/1986] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:06.496069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.506099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535fe3-646a-4062-a2ab-ae65c350caa5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.510706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.511399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.511682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.512041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.512760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.514427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d2e09-593a-45f3-ab88-943642f2ec04 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.524830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1005/1987] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:40:06.529285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.539180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567c06-7cb1-4148-9e75-4dd6fa8c6bd0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.544101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.545027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.545303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.545608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] PATH_INFO: `/v3/projects/16cc9cdae65c4becba5d6cf1098f72dc/users/a5c66879c0b147ea8e757363bd428977/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.561210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cc9cdae65c4becba5d6cf1098f72dc, user_id=a5c66879c0b147ea8e757363bd428977, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.563949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.577845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 983/1988] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:06 2022] PUT /identity/v3/projects/16cc9cdae65c4becba5d6cf1098f72dc/users/a5c66879c0b147ea8e757363bd428977/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:06.588545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.588906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.589246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.617288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] MFA Rules not processed for user `a5c66879c0b147ea8e757363bd428977`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:06.618823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:06.690847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1006/1989] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:06.703241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.705258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:06.768342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345c6c5-3ba3-4a75-b866-617a15b983f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.776026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.776727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.777195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.777545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.787244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.788904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d48c0d-dc52-447c-96ff-231ce994b4bd service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.798903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 984/1990] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:09.637485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:09.638971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:09.716266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c91e-930b-4289-ae3a-0f0f8dabac6a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:09.721679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:09.723021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:09.723672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:09.724189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] PATH_INFO: `/v3/users/91616faf3d0f4078a13b4b1d94c0a9cc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:09.725803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91616faf3d0f4078a13b4b1d94c0a9cc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:09.728489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:09.807600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91616faf3d0f4078a13b4b1d94c0a9cc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:09.811380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:09.825125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91616faf3d0f4078a13b4b1d94c0a9cc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:09.826264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91616faf3d0f4078a13b4b1d94c0a9cc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:09.840372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91616faf3d0f4078a13b4b1d94c0a9cc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:09.841280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91616faf3d0f4078a13b4b1d94c0a9cc'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:09.872845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1007/1991] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:09 2022] DELETE /identity/v3/users/91616faf3d0f4078a13b4b1d94c0a9cc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:09.881208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:09.881753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:09.881832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:09.907289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:09.908538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:09.972167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 985/1992] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:09.982294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:09.983868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.041846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a16d-20ef-4471-8abb-c9bb293ab98f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.045701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.046431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.046713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.047008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.058277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.059797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3822b-cd71-4cda-807d-14139f109a95 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.069824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1008/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:10.142972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:10.145087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.160943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdd299-31ce-4d66-b35f-61effcd76855 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.182124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.185482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.185951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.186977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] PATH_INFO: `/v3/users/ff949722ca9447c8b21c0301346e7b85` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.191295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff949722ca9447c8b21c0301346e7b85)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.198023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.260434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:10.267160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff949722ca9447c8b21c0301346e7b85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.275890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff949722ca9447c8b21c0301346e7b85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.285413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff949722ca9447c8b21c0301346e7b85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.286124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff949722ca9447c8b21c0301346e7b85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.319843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff949722ca9447c8b21c0301346e7b85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.346144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 986/1994] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:10 2022] DELETE /identity/v3/users/ff949722ca9447c8b21c0301346e7b85 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:10.351910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.352206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.352490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.376197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:10.377681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.491518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1009/1995] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:10.503252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:10.504748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.521674 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:10.523314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.551001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0998-a38b-47e8-9d45-cf448d750934 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.556318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.557287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.557640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.558469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] PATH_INFO: `/v3/projects/ba1cb55b3ccd4340a987e2b9782e411d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.559559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1cb55b3ccd4340a987e2b9782e411d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.561647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.609919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9601-9cf3-4f6a-be85-4bf1ee3d5fc0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.623288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1cb55b3ccd4340a987e2b9782e411d', 'request_id': 'req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.631306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1cb55b3ccd4340a987e2b9782e411d', 'request_id': 'req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.639588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1cb55b3ccd4340a987e2b9782e411d', 'request_id': 'req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.643437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:10.670347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] The token cache is being invalidate because project ba1cb55b3ccd4340a987e2b9782e411d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:10.670731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.672627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.675301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1010/1996] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:10 2022] DELETE /identity/v3/projects/ba1cb55b3ccd4340a987e2b9782e411d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:10.679487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:10.681713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.686901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.688034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.688672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.689635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.691596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.807590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168138a6-5967-4bb9-8cf8-a4c38b3f9d4d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.820655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.821677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.821914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.822041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.822296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] PATH_INFO: `/v3/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.823560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.824275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5acbd5dfe444c6a8ce3e2c5a5f28e9)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.826117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.842703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 987/1997] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:10.922928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5acbd5dfe444c6a8ce3e2c5a5f28e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.936178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5acbd5dfe444c6a8ce3e2c5a5f28e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.937093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5acbd5dfe444c6a8ce3e2c5a5f28e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.956750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5acbd5dfe444c6a8ce3e2c5a5f28e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.957495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5acbd5dfe444c6a8ce3e2c5a5f28e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:10.989493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1011/1998] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:10 2022] DELETE /identity/v3/users/af5acbd5dfe444c6a8ce3e2c5a5f28e9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:11.402588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:11.405794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:11.454883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952545e5-424d-46b9-be4e-13b3cba05136 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:11.490673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:11.539386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:11.540793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:11.588205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:11.589571 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.589970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.590315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] PATH_INFO: `/v3/projects/923be056c52649f29600839f943a0d14` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.592308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923be056c52649f29600839f943a0d14)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:11.594412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:11.666838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923be056c52649f29600839f943a0d14', 'request_id': 'req-a0c66f94-53cc-4af4-bbc5-7f616533d663'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.681357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923be056c52649f29600839f943a0d14', 'request_id': 'req-a0c66f94-53cc-4af4-bbc5-7f616533d663'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.695272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923be056c52649f29600839f943a0d14', 'request_id': 'req-a0c66f94-53cc-4af4-bbc5-7f616533d663'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.722045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] The token cache is being invalidate because project 923be056c52649f29600839f943a0d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:11.722348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.723011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.724974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 988/1999] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:11 2022] DELETE /identity/v3/projects/923be056c52649f29600839f943a0d14 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:11.730244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:11.731003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:11.732867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9120f3-ab4c-4c78-9701-85080b92fad2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:11.751065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:11.805593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:11.806743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.807107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.807504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] PATH_INFO: `/v3/projects/c6e0b454ab1845769075117838a11ebd` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.809594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e0b454ab1845769075117838a11ebd)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:11.811695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:11.814955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c66f94-53cc-4af4-bbc5-7f616533d663 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:11.821111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:11.822193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.822572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.823383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] PATH_INFO: `/v3/users/639e2f13cc784030ad1fef5d0cd28936` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.824309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639e2f13cc784030ad1fef5d0cd28936)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:11.826334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:11.866260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e0b454ab1845769075117838a11ebd', 'request_id': 'req-fcd4c32e-67e8-4427-b549-62b77c49672d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.873863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e0b454ab1845769075117838a11ebd', 'request_id': 'req-fcd4c32e-67e8-4427-b549-62b77c49672d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.880320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e0b454ab1845769075117838a11ebd', 'request_id': 'req-fcd4c32e-67e8-4427-b549-62b77c49672d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.892364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639e2f13cc784030ad1fef5d0cd28936'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.897522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] The token cache is being invalidate because project c6e0b454ab1845769075117838a11ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:11.898449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.898614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:11.899501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcd4c32e-67e8-4427-b549-62b77c49672d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.901046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639e2f13cc784030ad1fef5d0cd28936'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.901954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1012/2000] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:11 2022] DELETE /identity/v3/projects/c6e0b454ab1845769075117838a11ebd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:11.908971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.909355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.909702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.910952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639e2f13cc784030ad1fef5d0cd28936'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.912555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639e2f13cc784030ad1fef5d0cd28936'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.932519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dc0f49b0-a012-462b-a50a-57b656e58547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639e2f13cc784030ad1fef5d0cd28936'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:11.934346 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:11.935713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:11.939737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 989/2001] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:11 2022] DELETE /identity/v3/users/639e2f13cc784030ad1fef5d0cd28936 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:12.029245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.029550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.029833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.043567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1013/2002] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:12.052408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:12.054042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.129832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 990/2003] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:12.131209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.143443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87054e72-4d00-4e02-9a55-88bae974e697 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.150333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.151188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.151709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.152344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.153892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:12.154426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.156473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.206096 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1014/2004] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:12.207058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.218510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88b3a-e916-4200-840b-67cf393aa553 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.228169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.229249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.230318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.230973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.233108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.236023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.292926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 991/2005] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:12.297587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.310163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47f7a-c1b3-4ae0-8df0-06a33c5f608c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.393517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:12.397549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.400230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.423827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.424615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.424846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.425759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.426632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.429526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.456209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1015/2006] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:12.459681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.471723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157130fd-88cc-4bd9-ba68-bbf581b938cd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.479368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.480195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.480711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.480961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.481879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.483715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.498564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1016/2007] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:12.499616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.505323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bf34a-e720-4e9c-a4d3-2cd4ec07d12c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.509522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7889a-7100-44fb-bf4a-05af4c3a0752 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.510504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.511448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.511866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.512140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] PATH_INFO: `/v3/projects/00cb0e91aed64b7d8783874cc52def37` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.513351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cb0e91aed64b7d8783874cc52def37)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.515268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.515810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.516972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.517497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.517924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.518583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.520524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.539693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1017/2008] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:12.541061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.552176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7a60-c617-4060-b798-63e2c5fe3137 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.567425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cb0e91aed64b7d8783874cc52def37', 'request_id': 'req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:12.569979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:12.577301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cb0e91aed64b7d8783874cc52def37', 'request_id': 'req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:12.584618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cb0e91aed64b7d8783874cc52def37', 'request_id': 'req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:12.600107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] The token cache is being invalidate because project 00cb0e91aed64b7d8783874cc52def37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:12.600394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:12.601074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c38f97ea-12c1-4bdc-9d87-d4e202ce0159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:12.602680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 992/2009] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:12 2022] DELETE /identity/v3/projects/00cb0e91aed64b7d8783874cc52def37 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:12.607514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f7cb-cfbb-4915-bc99-a0d576ea976c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.608661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f7cb-cfbb-4915-bc99-a0d576ea976c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.608901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f7cb-cfbb-4915-bc99-a0d576ea976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.630012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.631776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.632016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6da0f7cb-cfbb-4915-bc99-a0d576ea976c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:12.632121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.632729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] PATH_INFO: `/v3/projects/71e26a3c9597435aa3ed9a4e1f677876/users/e9b5e75ab1f0482da14a0f4895dc9f2b/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.633341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6da0f7cb-cfbb-4915-bc99-a0d576ea976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.643391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 993/2010] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:12.649198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.649343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e26a3c9597435aa3ed9a4e1f677876, user_id=e9b5e75ab1f0482da14a0f4895dc9f2b, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.649532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.649758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.651996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e64aea-e0d3-4475-b464-acb85e3682a7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.669660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1018/2011] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:12 2022] PUT /identity/v3/projects/71e26a3c9597435aa3ed9a4e1f677876/users/e9b5e75ab1f0482da14a0f4895dc9f2b/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:12.672448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:12.673863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.680353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.680646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.680925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.710268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] MFA Rules not processed for user `e9b5e75ab1f0482da14a0f4895dc9f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:12.711977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.746325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 994/2012] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:12.750884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.761472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b65112-93f2-4d0d-8c05-be4f05966d9b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.768176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.769158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.770240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.770698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.775834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:12.776255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.778334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.788775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1019/2013] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:12.793161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.794720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:12.796982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 995/2014] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:12.801154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.809979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bdee9-8662-4c89-9424-43daed76afc5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.812915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a061-97c1-4240-a588-c1ea5d7d30df admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.815234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.816016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.816370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.816737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.817504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.818910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.819447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.819849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.820211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.820576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.821346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.823766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.835622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:12.859526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1020/2015] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:12.860885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.866280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 996/2016] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:12.868796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:12.962913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8c15-703d-42ef-8209-d5784c1b144e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.972203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708274da-5d26-42ce-a9eb-9419d1a3de2a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:12.977395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.978177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.978517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.978861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.979103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:12.979743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.980450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:12.981600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:12.982116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:12.982461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:12.983702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:12.986035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.013897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 997/2017] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:13.015211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.018563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1021/2018] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:12 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:13.023981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.031687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d21c-30a4-411e-b9aa-851e73ea22bb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.037066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.037843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.038412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b78b-65e8-4921-b87f-3b1b15e0dd13 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.043593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.044046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.044902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.046710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.050566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.051256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.051570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.051845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.052569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.054165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.068796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 998/2020] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:13.069015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1022/2020] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:13.072632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.075461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.088247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fe25c-6cfc-43a0-9c8a-abbd3480194c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.097511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6470ca0-03e9-440a-bfde-19e56b68efdc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.099650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.101374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.101662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.101936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] PATH_INFO: `/v3/projects/223cc65c55f347d3b8a489b8728c40d2/users/96787b5a309345afa33cd889a0960f39/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.102032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.102747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.102977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.103250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.107431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.107431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.120198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1023/2021] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:13.124266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.125534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223cc65c55f347d3b8a489b8728c40d2, user_id=96787b5a309345afa33cd889a0960f39, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.128350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.131499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:13.134912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4862d-5f53-4746-b2ce-4a0d6c28cf76 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.140508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.141554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.141836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.142090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] PATH_INFO: `/v3/projects/b2fef8d0cb974f35a741c3090fda97f1/users/e7e1bce062244098888ecb72b11ccd88/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.144653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 999/2022] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:13 2022] PUT /identity/v3/projects/223cc65c55f347d3b8a489b8728c40d2/users/96787b5a309345afa33cd889a0960f39/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:13.148492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.158227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fef8d0cb974f35a741c3090fda97f1, user_id=e7e1bce062244098888ecb72b11ccd88, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.161313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225fb25-965b-49db-aa93-6087027cf315 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.176125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1024/2023] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:13 2022] PUT /identity/v3/projects/b2fef8d0cb974f35a741c3090fda97f1/users/e7e1bce062244098888ecb72b11ccd88/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:13.181256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.181544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.181872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.198778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:13.200562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:13.209162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249346-2c3f-404e-8d54-dfb7170c3c83 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.264744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1025/2024] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:13.270223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.271026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.271303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.271602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.272328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.274137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.274563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.276225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:13.285359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1000/2025] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:40:13.289365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.300606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c73e2-5687-4bf2-9253-a5bb6e1255a0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.305390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.306314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.306600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.306877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] PATH_INFO: `/v3/projects/223cc65c55f347d3b8a489b8728c40d2/users/96787b5a309345afa33cd889a0960f39/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.308988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] RBAC: Authorizing `identity:create_grant(project_id=223cc65c55f347d3b8a489b8728c40d2, user_id=96787b5a309345afa33cd889a0960f39, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.311711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec618-8ca5-4003-b625-081d98ee152d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.324562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:13.326095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1001/2026] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:13 2022] PUT /identity/v3/projects/223cc65c55f347d3b8a489b8728c40d2/users/96787b5a309345afa33cd889a0960f39/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:40:13.339085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.339678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.340129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.342426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52fed9-51e9-4569-9895-88ebe789cdeb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.368009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] MFA Rules not processed for user `96787b5a309345afa33cd889a0960f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:13.369220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:13.402390 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.403880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.404644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.405155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.491870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1002/2027] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:13.501323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.503682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.515693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1026/2028] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:13.630858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.632517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:13.645944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:13.706197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe68365-2d65-4437-b747-eecef45446fb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.712124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.713733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.714102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.715562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.727578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.729197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2ff86-a611-4636-89c2-933fa74a8c93 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.751574 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1003/2029] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:16.292876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:16.319853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025808c2-e3cd-4724-a1a3-489e782fbaa9 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:16.353606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:16.356791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:16.357164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:16.357428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] PATH_INFO: `/v3/users/e9b5e75ab1f0482da14a0f4895dc9f2b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:16.363082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b5e75ab1f0482da14a0f4895dc9f2b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:16.371852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:16.479518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b5e75ab1f0482da14a0f4895dc9f2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:16.488301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b5e75ab1f0482da14a0f4895dc9f2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:16.489028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b5e75ab1f0482da14a0f4895dc9f2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:16.501971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b5e75ab1f0482da14a0f4895dc9f2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:16.504654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b5e75ab1f0482da14a0f4895dc9f2b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:16.531691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1027/2030] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:16 2022] DELETE /identity/v3/users/e9b5e75ab1f0482da14a0f4895dc9f2b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:16.536241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:16.536839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:16.536929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:16.558101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:16.560040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:16.673813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1004/2031] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:16.684000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:16.685656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:16.708289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:16.766139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13792-d5a2-4280-b9d4-c2998129852a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:16.774597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:16.775298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:16.775622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:16.775948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:16.802857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:16.804612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:16.824195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1028/2032] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:17.270248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:17.272102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:17.290783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939dfb9-e295-4144-964d-d8496ee34887 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:17.304725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:17.315541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:17.315869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:17.316154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] PATH_INFO: `/v3/projects/71e26a3c9597435aa3ed9a4e1f677876` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:17.319849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e26a3c9597435aa3ed9a4e1f677876)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:17.322041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:17.431765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e26a3c9597435aa3ed9a4e1f677876', 'request_id': 'req-594d768c-0dfd-4428-a400-867152c0f102'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.455385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e26a3c9597435aa3ed9a4e1f677876', 'request_id': 'req-594d768c-0dfd-4428-a400-867152c0f102'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.464172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e26a3c9597435aa3ed9a4e1f677876', 'request_id': 'req-594d768c-0dfd-4428-a400-867152c0f102'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.499828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] The token cache is being invalidate because project 71e26a3c9597435aa3ed9a4e1f677876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:17.502267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.503717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.509057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1005/2033] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:17 2022] DELETE /identity/v3/projects/71e26a3c9597435aa3ed9a4e1f677876 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:17.513163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:17.553289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177c16-6645-4982-9055-57f94eeacb90 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:17.678861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:17.679887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:17.680133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:17.680411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] PATH_INFO: `/v3/users/96787b5a309345afa33cd889a0960f39` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:17.681908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96787b5a309345afa33cd889a0960f39)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:17.688695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:17.794954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96787b5a309345afa33cd889a0960f39'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.805444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96787b5a309345afa33cd889a0960f39'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.806183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96787b5a309345afa33cd889a0960f39'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.822100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96787b5a309345afa33cd889a0960f39'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.827865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b891c800-e726-4553-9baf-49a72871f3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96787b5a309345afa33cd889a0960f39'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:17.864746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1029/2034] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:17 2022] DELETE /identity/v3/users/96787b5a309345afa33cd889a0960f39 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:18.332538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:18.334808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:18.353115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d768c-0dfd-4428-a400-867152c0f102 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:18.394478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:18.426419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:18.427432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.427788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.428165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] PATH_INFO: `/v3/projects/223cc65c55f347d3b8a489b8728c40d2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.429489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] RBAC: Authorizing `identity:delete_project(project_id=223cc65c55f347d3b8a489b8728c40d2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:18.431874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:18.499877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223cc65c55f347d3b8a489b8728c40d2', 'request_id': 'req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:18.512411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223cc65c55f347d3b8a489b8728c40d2', 'request_id': 'req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:18.523077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223cc65c55f347d3b8a489b8728c40d2', 'request_id': 'req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:18.550227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] The token cache is being invalidate because project 223cc65c55f347d3b8a489b8728c40d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:18.550526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:18.558030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b5e15ceb-ff6f-4d27-8dc3-24d05895005c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:18.560943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1006/2035] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:18 2022] DELETE /identity/v3/projects/223cc65c55f347d3b8a489b8728c40d2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:18.565999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.566389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.566549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.586822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:18.588769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:18.638638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:18.678931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1030/2036] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:18.687855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.688476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.689865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.744375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:18.746325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:18.756652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1007/2037] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:18.761212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:18.772214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eda617-becc-43ae-90e2-b01e5e183fd3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:18.777526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:18.778647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.779894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.780020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.781379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:18.781664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:18.785709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:18.804344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1031/2038] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:40:18.805661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:18.816083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33454e2-a691-48a7-8ba6-78ace7655e28 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:18.822385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:18.825041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.825503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.826086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.826976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:18.836981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:18.875322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1008/2039] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:18 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:18.876661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:18.887630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441d02a-7ba5-4152-a95b-7c19ad564c46 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:18.971425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:18.971425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.971425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.971425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.971878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:18.971878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:18.996617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1032/2040] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:18 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:19.002224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.018850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a72fb-553e-402c-9f69-cb74db96c648 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.026651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.028336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.028625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.028901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.030385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.032840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.050782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1009/2041] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:19.054929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.068325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482f28-2969-41e7-beb3-60bc0aa0dc35 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.077902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.078713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.079457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.079925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.080965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.082851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83db411-9c0a-4fcf-bfc6-6491b8fbaa67 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.119017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1033/2042] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:19.122894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.133979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8d35-4f29-40d2-a4b1-cceaefa100e2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.140794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.141751 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.142037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.142312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] PATH_INFO: `/v3/projects/5dce0056ec7b4f39a6f3022f0a40ac1e/users/043b88d5b3b842e49f60f1ed1b237351/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.194361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce0056ec7b4f39a6f3022f0a40ac1e, user_id=043b88d5b3b842e49f60f1ed1b237351, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.199239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.230277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1010/2043] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:19 2022] PUT /identity/v3/projects/5dce0056ec7b4f39a6f3022f0a40ac1e/users/043b88d5b3b842e49f60f1ed1b237351/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:19.242282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.242545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.242824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.294160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] MFA Rules not processed for user `043b88d5b3b842e49f60f1ed1b237351`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:19.295943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:19.403476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1034/2044] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:19.404791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.496353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8378-644d-4dc1-bef3-b6e52c44e3a3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.502906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.503629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.503918 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.504257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.504914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.506865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bc9a-9014-4d25-a275-26382572b3b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.511549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:19.550136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1011/2045] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:19.551440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.572736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5838a-bbf2-402b-8e35-b759e9ac75bb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.638030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512996-c427-4902-b92a-3a33f352468b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.638350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512996-c427-4902-b92a-3a33f352468b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.638651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512996-c427-4902-b92a-3a33f352468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.664820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:19.689856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0d512996-c427-4902-b92a-3a33f352468b None None] MFA Rules not processed for user `e7e1bce062244098888ecb72b11ccd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:19.691129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0d512996-c427-4902-b92a-3a33f352468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:19.700032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.700949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.702057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.702057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.702904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.710378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.766196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1035/2046] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:19.770902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.793646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d2c7-e73e-4794-b925-d666185cda66 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.798946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.800103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.800454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.800795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.801701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.804861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.816607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1036/2047] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:19.826231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1012/2048] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:19.826449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.827312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512996-c427-4902-b92a-3a33f352468b None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.828770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0d512996-c427-4902-b92a-3a33f352468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:19.841698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a0c0b-480e-4e76-9b53-18210cbdf2c7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.848446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512996-c427-4902-b92a-3a33f352468b None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:19.852209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.853288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.853639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.853750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:19.853929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] PATH_INFO: `/v3/projects/c890907f4dab40f480800791704da1b9/users/30cb94d69dc34d54a6e6c73b14df0cb4/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.854533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:19.854951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:19.855537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:19.856314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.858315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.873873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c890907f4dab40f480800791704da1b9, user_id=30cb94d69dc34d54a6e6c73b14df0cb4, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:19.877683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:19.900700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1037/2049] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:19 2022] PUT /identity/v3/projects/c890907f4dab40f480800791704da1b9/users/30cb94d69dc34d54a6e6c73b14df0cb4/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:19.901024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1013/2050] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:19.904592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.908362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:19.982662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5f294-a59e-42b0-b715-0b08544a8d4b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.004548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06d26-fd37-4e8b-bd59-728430586e25 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.015320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.018100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.018390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.018672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.022478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.024808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.059926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1014/2051] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:19 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:20.063829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.080707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309035-6bbb-4f91-b83e-c67b4315e570 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.087812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.093849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.093849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.093849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.093849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.093849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.103657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1015/2052] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:20.107899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.118657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.120220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.123059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.123525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.124395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.128264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.140140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240ee2-a747-4913-a825-250f8b00128a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.144409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1038/2053] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:20.145539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.156670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.159698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.159857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.160093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] PATH_INFO: `/v3/projects/1384cea9a217469faa4e25c0dd55639d/users/9fbd59bbb256494c81e2a7f0bbe83ad7/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.165761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038f50-188f-43c6-add6-398bffc9e5e8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.173389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.174612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.174921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.176087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] PATH_INFO: `/v3/projects/c890907f4dab40f480800791704da1b9/users/30cb94d69dc34d54a6e6c73b14df0cb4/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.179031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c890907f4dab40f480800791704da1b9, user_id=30cb94d69dc34d54a6e6c73b14df0cb4, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.179413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1384cea9a217469faa4e25c0dd55639d, user_id=9fbd59bbb256494c81e2a7f0bbe83ad7, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.181931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202171c-8ffb-4fed-ae45-128509d9698c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.183454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.197065 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1039/2054] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:20 2022] PUT /identity/v3/projects/c890907f4dab40f480800791704da1b9/users/30cb94d69dc34d54a6e6c73b14df0cb4/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:20.204127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1016/2055] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:20 2022] PUT /identity/v3/projects/1384cea9a217469faa4e25c0dd55639d/users/9fbd59bbb256494c81e2a7f0bbe83ad7/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:20.208387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.208693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.208956 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.211634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.231467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:20.267625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] MFA Rules not processed for user `30cb94d69dc34d54a6e6c73b14df0cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:20.268860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:20.295216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:20.360028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0185-3bc1-4897-89ad-41922fc7c8f5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.366595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.367756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.368049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.368333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.369799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.372084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.418698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1017/2056] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:20.423833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.435288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d95ae-266e-47ec-a868-51f7a0d4cd8a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.441477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.442720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.443078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.443564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] PATH_INFO: `/v3/projects/1384cea9a217469faa4e25c0dd55639d/users/9fbd59bbb256494c81e2a7f0bbe83ad7/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.445949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1384cea9a217469faa4e25c0dd55639d, user_id=9fbd59bbb256494c81e2a7f0bbe83ad7, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.447740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1040/2057] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:20.449166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69747e9-cca4-441c-be29-d5b4883e5543 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.467855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1018/2058] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:20 2022] PUT /identity/v3/projects/1384cea9a217469faa4e25c0dd55639d/users/9fbd59bbb256494c81e2a7f0bbe83ad7/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:20.469453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.474097 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:20.566681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8771-0606-4a6d-83c1-a0b68bd0cf5a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.688522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.689056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.690968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.691299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.836967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.839361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.875421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1041/2059] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:26.330229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:26.330781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:26.331176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:26.362066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] MFA Rules not processed for user `9fbd59bbb256494c81e2a7f0bbe83ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:26.363447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:26.436825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1019/2060] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:26.451304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:26.453317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:26.472573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:26.545808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c204f7-8f25-439f-9097-fc9d76554a08 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:26.552404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:26.553160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:26.553502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:26.553833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:26.642756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:26.644395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a598-28cf-4917-b7e7-21bfb613a939 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:26.654568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1042/2061] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:27.035111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:27.048055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5621-3541-4d97-b06d-b0771147ca74 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:27.054287 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:27.055007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:27.055291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:27.055642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:27.142057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:27.143747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:27.155577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1020/2062] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:27.942263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:27.942797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:27.942797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:27.961520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] MFA Rules not processed for user `e7e1bce062244098888ecb72b11ccd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:27.962663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:27.971360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1043/2063] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:37.150146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:37.955715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=52 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:47.688839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:47.690559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:47.770117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e843-a1d9-4f20-b6a0-f15159301596 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:47.775507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:47.776480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:47.776800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:47.777129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] PATH_INFO: `/v3/users/d503b205ca214601a119535611899e95` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:47.778427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d503b205ca214601a119535611899e95)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:47.780720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:47.836966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd503b205ca214601a119535611899e95'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:47.845450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd503b205ca214601a119535611899e95'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:47.855935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd503b205ca214601a119535611899e95'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:47.856684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd503b205ca214601a119535611899e95'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:47.869436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2d26bca5-2e17-45fb-b955-f043cab2d835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd503b205ca214601a119535611899e95'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:47.876025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1021/2064] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:40:47 2022] DELETE /identity/v3/users/d503b205ca214601a119535611899e95 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:48.076944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.097026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164035-e5fc-4a79-9870-8e2e88a3a84b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.161717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.162677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.162955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.163249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] PATH_INFO: `/v3/projects/8e4aa13d65ad43b1849bad5bfa99e459` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.164462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4aa13d65ad43b1849bad5bfa99e459)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.166376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.219046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4aa13d65ad43b1849bad5bfa99e459', 'request_id': 'req-2073ba6b-7b46-4a58-a901-04f50d97bcb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:48.229344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4aa13d65ad43b1849bad5bfa99e459', 'request_id': 'req-2073ba6b-7b46-4a58-a901-04f50d97bcb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:48.236261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4aa13d65ad43b1849bad5bfa99e459', 'request_id': 'req-2073ba6b-7b46-4a58-a901-04f50d97bcb3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:48.249544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] The token cache is being invalidate because project 8e4aa13d65ad43b1849bad5bfa99e459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:40:48.249833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:48.250963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2073ba6b-7b46-4a58-a901-04f50d97bcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:40:48.254189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1044/2065] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:40:48 2022] DELETE /identity/v3/projects/8e4aa13d65ad43b1849bad5bfa99e459 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:48.259477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.259952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.260239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.300687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:48.302008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:48.378259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1022/2066] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:48.386553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7273-513b-4409-a408-125263410c0d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.386869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7273-513b-4409-a408-125263410c0d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.387192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7273-513b-4409-a408-125263410c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.406578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a40a7273-513b-4409-a408-125263410c0d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:48.407825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a40a7273-513b-4409-a408-125263410c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:48.415817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1045/2067] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:48.420730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.430999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a417b31-0262-453e-8017-d122038d58f2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.436023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.436780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.437064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.437325 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.438066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:40:48.438447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.440177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.454218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1023/2068] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:40:48.458804 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7273-513b-4409-a408-125263410c0d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.469442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7273-513b-4409-a408-125263410c0d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.477655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.478351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.478634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.478905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.479992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.481800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.511983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1046/2069] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:48.516226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.526386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075d49-a9eb-4344-88cc-fe684a53a9ba admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.532274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:48.604341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.604962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.605247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.605582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.606306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.608464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.634643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1024/2070] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:48.638692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.651412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9608e-a323-42f0-92c9-2c8a14b1d658 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.656726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.657848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.658135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.658413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.659149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.661053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.677583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1047/2071] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:48.679572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.693460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2afd-3b91-43c0-a453-205992eb9570 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.702911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.703704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.704060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.704407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.705216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.707062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c931-cdd9-4ca0-a70f-4ffef54c2217 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.726082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1025/2072] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:48.730391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.742154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c808f-0fdd-48db-9390-bd07bb560244 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.747064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.747998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.748282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.748581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] PATH_INFO: `/v3/projects/805c31aa744d42cf8f16acfed918bbbf/users/290fa827accb45d5a72e90d072b27391/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.766540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=805c31aa744d42cf8f16acfed918bbbf, user_id=290fa827accb45d5a72e90d072b27391, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.770815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:48.787027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1048/2073] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:48 2022] PUT /identity/v3/projects/805c31aa744d42cf8f16acfed918bbbf/users/290fa827accb45d5a72e90d072b27391/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:48.797382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.797698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.797976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.830298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] MFA Rules not processed for user `290fa827accb45d5a72e90d072b27391`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:48.832166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:48.906614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1026/2074] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:48.911408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:48.946617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:48.982737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0fa87-81e3-46e1-94c3-e47b46dc96aa admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:48.987499 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311274-831e-4da0-9485-653ba584661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:48.988164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311274-831e-4da0-9485-653ba584661b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:48.988474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311274-831e-4da0-9485-653ba584661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:48.988860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311274-831e-4da0-9485-653ba584661b admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:48.989580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311274-831e-4da0-9485-653ba584661b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:48.991572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311274-831e-4da0-9485-653ba584661b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.018102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1049/2075] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:40:48 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:40:49.022359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.036953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f7f4-81f9-443e-a566-dc79a8575c95 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.099657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.100379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.100664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.100940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.101670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.104081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.127868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1027/2076] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:40:49 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:40:49.131866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311274-831e-4da0-9485-653ba584661b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.142697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311274-831e-4da0-9485-653ba584661b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.147645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.148306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.148588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.148870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.149593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.151569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.162451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1050/2077] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:49.166776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.173786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:49.178141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906be5e-0308-4a06-8a66-8ed6f06b5004 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.184321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.185211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.185459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.185729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] PATH_INFO: `/v3/projects/e4fef6259f1042de9ace3b10aefad2a5/users/9ea36b814db94dbdbaee2478147b055c/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.203685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fef6259f1042de9ace3b10aefad2a5, user_id=9ea36b814db94dbdbaee2478147b055c, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.206411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.223909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1028/2078] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:49 2022] PUT /identity/v3/projects/e4fef6259f1042de9ace3b10aefad2a5/users/9ea36b814db94dbdbaee2478147b055c/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:49.228225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.246452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7396c-ba2f-469d-aa59-3fbe380b0734 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.305140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.305827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.306082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.306361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.307085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.310909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf1480-ce91-42df-8691-c6b8e434e039 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.319949 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1051/2079] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:49.323979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.334799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a353a-3e3c-4629-b813-d208da1faf6b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.340406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.341310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.341911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.342229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] PATH_INFO: `/v3/projects/e4fef6259f1042de9ace3b10aefad2a5/users/9ea36b814db94dbdbaee2478147b055c/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.344289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fef6259f1042de9ace3b10aefad2a5, user_id=9ea36b814db94dbdbaee2478147b055c, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.347004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.358990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1029/2080] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:40:49 2022] PUT /identity/v3/projects/e4fef6259f1042de9ace3b10aefad2a5/users/9ea36b814db94dbdbaee2478147b055c/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:40:49.370657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.370943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.371220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.400745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] MFA Rules not processed for user `9ea36b814db94dbdbaee2478147b055c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:49.401964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:49.471190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1052/2081] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:40:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:49.483527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.485506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:49.551154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31239e7-a5ea-4da6-9b48-b93182515a1d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.560738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.560738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.560738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.560738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.571547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.572973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.583270 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1030/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:49.664756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:49.674493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592258b-2aaa-47c2-819d-923832cf66bb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:49.678341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:49.678974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:49.679269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:49.679579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:49.701893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:49.745056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:49.746446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458862-0241-4ffe-9b2b-a522c3117dd5 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:49.756383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1053/2083] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:59.578849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:59.755183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=18 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:02.836080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:02.906487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd6f3-4d4b-49e1-ba9e-fc1953f9bb66 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:02.912067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:02.912895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:02.913494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:02.913494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] PATH_INFO: `/v3/users/290fa827accb45d5a72e90d072b27391` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:02.914802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=290fa827accb45d5a72e90d072b27391)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:02.917050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:02.968346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290fa827accb45d5a72e90d072b27391'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:02.975291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290fa827accb45d5a72e90d072b27391'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:02.984169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290fa827accb45d5a72e90d072b27391'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:02.984882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290fa827accb45d5a72e90d072b27391'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:02.997351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290fa827accb45d5a72e90d072b27391'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.003301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1031/2084] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:02 2022] DELETE /identity/v3/users/290fa827accb45d5a72e90d072b27391 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:03.008039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:03.008497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:03.008607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:03.028791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:03.030070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:03.099189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1054/2085] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:03.109501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:03.110984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:03.171382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f079-8bb7-4ce5-8904-8df740ee3c0c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:03.175411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:03.176060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:03.176341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:03.176620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:03.187268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:03.189626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:03.200392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1032/2086] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:03.558362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:03.560506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:03.581569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8c19-45e0-4457-97a2-462bf0cdcdb9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:03.593388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:03.594362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:03.594648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:03.595078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] PATH_INFO: `/v3/projects/805c31aa744d42cf8f16acfed918bbbf` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:03.596511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=805c31aa744d42cf8f16acfed918bbbf)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:03.598686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:03.657968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805c31aa744d42cf8f16acfed918bbbf', 'request_id': 'req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.669788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805c31aa744d42cf8f16acfed918bbbf', 'request_id': 'req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.676969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805c31aa744d42cf8f16acfed918bbbf', 'request_id': 'req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.699554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] The token cache is being invalidate because project 805c31aa744d42cf8f16acfed918bbbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:03.699823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.700724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.702394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1055/2087] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:03 2022] DELETE /identity/v3/projects/805c31aa744d42cf8f16acfed918bbbf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:03.706356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:03.716634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd9e2-93fc-4010-bf64-d3b28a66141e service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:03.736969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:03.779702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:03.780666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:03.781086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:03.781431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] PATH_INFO: `/v3/users/9ea36b814db94dbdbaee2478147b055c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:03.782829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea36b814db94dbdbaee2478147b055c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:03.784995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:03.849022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea36b814db94dbdbaee2478147b055c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.855524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea36b814db94dbdbaee2478147b055c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.867060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea36b814db94dbdbaee2478147b055c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.867784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea36b814db94dbdbaee2478147b055c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.885107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea36b814db94dbdbaee2478147b055c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:03.898212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1033/2088] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:03 2022] DELETE /identity/v3/users/9ea36b814db94dbdbaee2478147b055c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:04.006692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.008263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.023424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.025794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.027103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c83ed7-307f-4d2c-8dfc-1aae822eb19a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.115637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.116657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.117042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.117416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] PATH_INFO: `/v3/users/043b88d5b3b842e49f60f1ed1b237351` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.118896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=043b88d5b3b842e49f60f1ed1b237351)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.121580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.159542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2a41-aef4-47f7-96af-ab46a691208b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.165162 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:04.170392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.171936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.172886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.173436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] PATH_INFO: `/v3/users/af379dc0045d4dc6bb7d68137f428e80` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.176429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af379dc0045d4dc6bb7d68137f428e80)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.178626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.200161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043b88d5b3b842e49f60f1ed1b237351'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.211145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043b88d5b3b842e49f60f1ed1b237351'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.212178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043b88d5b3b842e49f60f1ed1b237351'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.224088 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043b88d5b3b842e49f60f1ed1b237351'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.225064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043b88d5b3b842e49f60f1ed1b237351'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.251406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:04.253313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1056/2089] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:04 2022] DELETE /identity/v3/users/043b88d5b3b842e49f60f1ed1b237351 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:04.255401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.256361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.265471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af379dc0045d4dc6bb7d68137f428e80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.273725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af379dc0045d4dc6bb7d68137f428e80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.281473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af379dc0045d4dc6bb7d68137f428e80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.282219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af379dc0045d4dc6bb7d68137f428e80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.296883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-46d5d4ea-80ff-41cf-a513-b14564017113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af379dc0045d4dc6bb7d68137f428e80'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.304088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1034/2090] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:04 2022] DELETE /identity/v3/users/af379dc0045d4dc6bb7d68137f428e80 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:04.308229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f1d7-d32a-42d7-b9fd-07d7955e148f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.308523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f1d7-d32a-42d7-b9fd-07d7955e148f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.308800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f1d7-d32a-42d7-b9fd-07d7955e148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.326341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1470f1d7-d32a-42d7-b9fd-07d7955e148f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:04.327736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1470f1d7-d32a-42d7-b9fd-07d7955e148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.331794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2559-b41b-41e5-b8e7-0ca0ed7075bf admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.388187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.392142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1035/2091] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:04.392281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.392281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.392281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] PATH_INFO: `/v3/projects/e4fef6259f1042de9ace3b10aefad2a5` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.392500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.392500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.392500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.392739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fef6259f1042de9ace3b10aefad2a5)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.396755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.408780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:04.409986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.417661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1036/2092] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:04.418429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.419643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.448661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fef6259f1042de9ace3b10aefad2a5', 'request_id': 'req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.450622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:04.455450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fef6259f1042de9ace3b10aefad2a5', 'request_id': 'req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.463406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fef6259f1042de9ace3b10aefad2a5', 'request_id': 'req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.479677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] The token cache is being invalidate because project e4fef6259f1042de9ace3b10aefad2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:04.480080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.480828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:04.480934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10b3e-e5ab-4a09-a576-fd141b20df51 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.482871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1057/2093] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:04 2022] DELETE /identity/v3/projects/e4fef6259f1042de9ace3b10aefad2a5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:04.484410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.486180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.533304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.533975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.534241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.534518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.536409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.549595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5d999-aa42-4b3a-8a0e-71bbc58c75db admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.553600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.554262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.554546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.554821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.556730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.566132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:04.613685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.615267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed67e1-172b-49ba-8e65-317bdcbbae60 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.625668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1037/2094] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:04.626974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.627443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.627873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.634846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.636542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb2f87-d063-49a5-935a-12d77c0b25e5 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.646721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:04.648075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.648617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1058/2095] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:04.656058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1038/2096] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:04.666033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.666033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.666033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.686544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:04.688049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.698032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1059/2097] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:04.702861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.713516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25319-0dbc-4b25-9dbb-97b0e583cae8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.721179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.721880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.722667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.723373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.724111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:04.724422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.726496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.741066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1039/2098] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:04.745957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.757422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec99db-5daa-4f48-bdff-cfcf5611e9cb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.764232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.764974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.765534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.765657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.766498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.770515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.807680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1060/2099] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:04.811926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.825373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d105e7-30d5-40b5-8f0f-b248c1ea7ee2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.887817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.888562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.888863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.889144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.889845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.892011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.914278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1040/2100] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:04.918156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.930489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79111-ba5f-432f-bca1-5bf551798f60 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.935793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.936454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.936745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.937021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.937745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.939378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.950576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1061/2101] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:04.954592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.965437 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f565764-5cd2-4a42-b334-b84c37d71e4f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.970216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.970947 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.971296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.971613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.972348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.973970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.984242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1041/2102] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:04.988449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.999484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfccb80-47d7-4b7a-9596-6bdc67f28778 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.004614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.005530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.005810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.006136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] PATH_INFO: `/v3/projects/21b1827996534d898d9fd444584977a7/users/54ba5eab1d2f422ab255cb5260ae3ada/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.015115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.016989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.025068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b1827996534d898d9fd444584977a7, user_id=54ba5eab1d2f422ab255cb5260ae3ada, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.028651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.035652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9516252-d3e6-4a85-b3ec-510e86222962 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.040756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.041729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.041946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.042200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] PATH_INFO: `/v3/projects/5dce0056ec7b4f39a6f3022f0a40ac1e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.043969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dce0056ec7b4f39a6f3022f0a40ac1e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.045912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.063715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1062/2103] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:04 2022] PUT /identity/v3/projects/21b1827996534d898d9fd444584977a7/users/54ba5eab1d2f422ab255cb5260ae3ada/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:05.064917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.066851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.104255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:05.111007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dce0056ec7b4f39a6f3022f0a40ac1e', 'request_id': 'req-3b59c130-1091-4b45-a29f-02ada65046b1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.120119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dce0056ec7b4f39a6f3022f0a40ac1e', 'request_id': 'req-3b59c130-1091-4b45-a29f-02ada65046b1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.127795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dce0056ec7b4f39a6f3022f0a40ac1e', 'request_id': 'req-3b59c130-1091-4b45-a29f-02ada65046b1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.140201 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6ad2-7081-4a4c-a169-0f052ee1eab0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.140984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] The token cache is being invalidate because project 5dce0056ec7b4f39a6f3022f0a40ac1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:05.141279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.141930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b59c130-1091-4b45-a29f-02ada65046b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.143573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1042/2104] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:05 2022] DELETE /identity/v3/projects/5dce0056ec7b4f39a6f3022f0a40ac1e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:05.144861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.145150 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.145425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.151002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:05.174401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] MFA Rules not processed for user `54ba5eab1d2f422ab255cb5260ae3ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:05.175645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.211552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.212512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.212864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.213220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] PATH_INFO: `/v3/projects/83cc8b9844a348d1b182d43ccdd33bf7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.214489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc8b9844a348d1b182d43ccdd33bf7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.216660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.252281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1043/2105] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:05.256780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.258240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.273511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc8b9844a348d1b182d43ccdd33bf7', 'request_id': 'req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.273686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f537-c2f3-4051-a2e6-732677660a38 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.279923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc8b9844a348d1b182d43ccdd33bf7', 'request_id': 'req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.287830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc8b9844a348d1b182d43ccdd33bf7', 'request_id': 'req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.303800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] The token cache is being invalidate because project 83cc8b9844a348d1b182d43ccdd33bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:05.304287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.304849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.310169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1063/2106] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:05 2022] DELETE /identity/v3/projects/83cc8b9844a348d1b182d43ccdd33bf7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:05.310169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.311250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.345214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.346308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.347189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.347189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] PATH_INFO: `/v3/users/30cb94d69dc34d54a6e6c73b14df0cb4` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.348706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cb94d69dc34d54a6e6c73b14df0cb4)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.350948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.399175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445de1e-a3e3-47f8-9ef4-729fd1f4645d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.411429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.423673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.424285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.426620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.427638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.433199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cb94d69dc34d54a6e6c73b14df0cb4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.434513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.441818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cb94d69dc34d54a6e6c73b14df0cb4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.453675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cb94d69dc34d54a6e6c73b14df0cb4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.455034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:05.455163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cb94d69dc34d54a6e6c73b14df0cb4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.480339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cb94d69dc34d54a6e6c73b14df0cb4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.493149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1064/2107] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:05 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:05.493149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.495110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1044/2108] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:05 2022] DELETE /identity/v3/users/30cb94d69dc34d54a6e6c73b14df0cb4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:05.496804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.498298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.502250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.523692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:05.599495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e2703-5f82-4ddb-982c-db3bf3399183 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.605755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80fa7-55c3-408b-abdd-0df337350056 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.611964 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.612926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.613213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.613521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] PATH_INFO: `/v3/users/762aff1f63a34e93a5e8b1226bb34e25` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.614309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.615365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.616131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.616460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.617372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.617757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762aff1f63a34e93a5e8b1226bb34e25)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.620716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.622594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.675053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1045/2109] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:05 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:05.676313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.691953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc752d3b-4884-4be6-8acc-e35b736aeccb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.699629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762aff1f63a34e93a5e8b1226bb34e25'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.702748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.704403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.704989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.705339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.707930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.710821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762aff1f63a34e93a5e8b1226bb34e25'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.710943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.711904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762aff1f63a34e93a5e8b1226bb34e25'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.724309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762aff1f63a34e93a5e8b1226bb34e25'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.725233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762aff1f63a34e93a5e8b1226bb34e25'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:05.725809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1046/2110] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:05.729826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.735800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:05.750630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea3406-8a02-4ca6-aee3-cd29e8a02bed admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.759069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1065/2111] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:05 2022] DELETE /identity/v3/users/762aff1f63a34e93a5e8b1226bb34e25 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:05.766559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:05.767826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:05.768428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:05.768879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] PATH_INFO: `/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0/users/2dc086cec8c34089a4e68a483a3d371d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:05.800980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eda3f6478d45a5b86cd1525452c2e0, user_id=2dc086cec8c34089a4e68a483a3d371d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:05.804553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:05.827958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1047/2112] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:05 2022] PUT /identity/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0/users/2dc086cec8c34089a4e68a483a3d371d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:05.831908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:05.932483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722af43-78e5-43b5-a3f4-b7f9880a9ca0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:05.953606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.034199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.034886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.035170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.035561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.036298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.038090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534449c7-60f2-477f-96c6-70519bb52236 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.050016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1066/2113] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:06.054521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.070370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5705d8-9f97-47a4-86ce-9eff3159b81c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.078775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.079717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.079997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.080271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] PATH_INFO: `/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0/users/2dc086cec8c34089a4e68a483a3d371d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.082503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eda3f6478d45a5b86cd1525452c2e0, user_id=2dc086cec8c34089a4e68a483a3d371d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.085591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.118917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1048/2114] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:06 2022] PUT /identity/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0/users/2dc086cec8c34089a4e68a483a3d371d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:06.129508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.129797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.130075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.164565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.165909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] MFA Rules not processed for user `2dc086cec8c34089a4e68a483a3d371d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.166610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.166928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.267483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1067/2115] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:06.268506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.270232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.281344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d000-2516-413f-90ea-3b2d23d1f50d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.286522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21c54-b02b-4c07-ada2-a912f6327a5e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.287033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.288189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.288499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.288841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] PATH_INFO: `/v3/projects/c890907f4dab40f480800791704da1b9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.290546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c890907f4dab40f480800791704da1b9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.291643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.292562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.292843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.292991 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.293100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] PATH_INFO: `/v3/projects/e4b911355e41401c97200e90ed0cb94e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.294288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b911355e41401c97200e90ed0cb94e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.296316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.348017 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c890907f4dab40f480800791704da1b9', 'request_id': 'req-cecb8687-61ae-4800-bb96-20d1117ddae4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.351533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.352220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b911355e41401c97200e90ed0cb94e', 'request_id': 'req-ec3fc9e1-0637-4e23-a449-19d10040c2ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.356752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c890907f4dab40f480800791704da1b9', 'request_id': 'req-cecb8687-61ae-4800-bb96-20d1117ddae4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.358514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b911355e41401c97200e90ed0cb94e', 'request_id': 'req-ec3fc9e1-0637-4e23-a449-19d10040c2ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.364893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c890907f4dab40f480800791704da1b9', 'request_id': 'req-cecb8687-61ae-4800-bb96-20d1117ddae4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.365577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b911355e41401c97200e90ed0cb94e', 'request_id': 'req-ec3fc9e1-0637-4e23-a449-19d10040c2ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.376680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] The token cache is being invalidate because project c890907f4dab40f480800791704da1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:06.376956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.377697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.378951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] The token cache is being invalidate because project e4b911355e41401c97200e90ed0cb94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:06.379248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.379433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1049/2116] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:06 2022] DELETE /identity/v3/projects/c890907f4dab40f480800791704da1b9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:06.382950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec3fc9e1-0637-4e23-a449-19d10040c2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:06.383062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.383062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.383205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1068/2117] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:06 2022] DELETE /identity/v3/projects/e4b911355e41401c97200e90ed0cb94e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:06.384283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb91ab-8eee-43b6-8a3d-6fdd22ae0482 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.384558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb91ab-8eee-43b6-8a3d-6fdd22ae0482 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.384830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb91ab-8eee-43b6-8a3d-6fdd22ae0482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.404407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c7eb91ab-8eee-43b6-8a3d-6fdd22ae0482 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.405588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c7eb91ab-8eee-43b6-8a3d-6fdd22ae0482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.418619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.446271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8687-61ae-4800-bb96-20d1117ddae4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.468132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1069/2118] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:06.469425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94eeb0-5b8f-4eae-a3a2-6fca995dbf1e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.469712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94eeb0-5b8f-4eae-a3a2-6fca995dbf1e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.469988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94eeb0-5b8f-4eae-a3a2-6fca995dbf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.487889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bc94eeb0-5b8f-4eae-a3a2-6fca995dbf1e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.489253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bc94eeb0-5b8f-4eae-a3a2-6fca995dbf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.495465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.496153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.496460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.496711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.498294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1070/2119] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:06.499594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d51-3ae8-436d-9528-3956624297c8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.499795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.499896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d51-3ae8-436d-9528-3956624297c8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.500144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d51-3ae8-436d-9528-3956624297c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.518303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-23024d51-3ae8-436d-9528-3956624297c8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.519540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23024d51-3ae8-436d-9528-3956624297c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.528108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1071/2120] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:06.531319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.531319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.531319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.547055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.548260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.556206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1072/2121] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:06.556954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.563107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.564593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.565825 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce89b30-0d70-4567-bd84-210d846067eb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.570413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.571042 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.571322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.571618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.572329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:06.572661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.574263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.574416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1050/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:06.575100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.587424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16fa-4677-4db1-936a-fbecfddf4574 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.588221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1073/2123] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:06.592514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.596697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.597749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.598090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.598460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.599248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:06.599664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.601315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.605926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad80f-a14a-4416-a260-b281eca51c7d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.610821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.611558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.611847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.612127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.612830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.615304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.618478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1051/2124] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:06.622626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.634002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cc080-9ad0-4d65-9c0e-ec35751986a5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.641383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.643026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.644981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.645338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.646114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.648081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.652660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1074/2125] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:06.656341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.686628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1052/2126] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:06.687563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.692000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.716188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.732552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cd24b-07e0-4d9d-931c-e2a904ccb52b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.783100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0280f1-0cd8-44cb-a5d5-f58d7a8ca2e2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.787410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.788264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.788658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.790311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.792710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.817644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.818417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.818772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.819117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.819931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.828746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.859132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1075/2127] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:06.859820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.866172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.871903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e057a6b-4d97-4acc-8ac4-1149721b8ec6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.876208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.877960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.878377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.879071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.879469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.879747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.880446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.882383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.889753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1053/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:06.890577 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.901666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c9ee0-97e4-48bd-b668-146c6a664e8d service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.908331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.908852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.909133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.909457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.910202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.911506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1076/2129] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:06.915198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.915360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.927551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1054/2130] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:06.928050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b746-9253-4d83-8e52-a4fe0110197f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.931693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.933458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.934282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.934563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.934836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.935707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.937764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.943827 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41257ef-ce3b-4cd0-9862-378c3e215f29 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.950762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.951484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1077/2131] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:06.954888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.955178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.955500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.956266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.957239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.957944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.969810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1055/2132] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:06.970155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3cccc-da08-4bb0-b7c1-f27a11bd13a9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.974326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.980030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.981095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.981095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.981271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.981963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.985264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.985552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece274-47b5-4782-8322-8937b79f0316 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.991999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.992966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.993205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.993474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] PATH_INFO: `/v3/projects/be1d6f7297c148ba8a5381684079c443/users/24d19ec6224e41519724cb8bde9f9d9c/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.003925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1078/2133] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:07.008442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.017994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1d6f7297c148ba8a5381684079c443, user_id=24d19ec6224e41519724cb8bde9f9d9c, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.020086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb926-720e-4611-ad70-e330c95e81ba admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.021634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a53ab-f2cd-4f00-9e44-c68e1ce1b1f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.030590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.031679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.032190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.032457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] PATH_INFO: `/v3/projects/50d7b2fc37f8448bb3afd507ad22538d/users/64ebb765deac481f995646724a3b3de9/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.039865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1056/2134] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:06 2022] PUT /identity/v3/projects/be1d6f7297c148ba8a5381684079c443/users/24d19ec6224e41519724cb8bde9f9d9c/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:07.051981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.052321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.052675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.057641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d7b2fc37f8448bb3afd507ad22538d, user_id=64ebb765deac481f995646724a3b3de9, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.061620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4c2dd-bd7d-4efe-961a-359efbe54186 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.079817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1079/2135] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:07 2022] PUT /identity/v3/projects/50d7b2fc37f8448bb3afd507ad22538d/users/64ebb765deac481f995646724a3b3de9/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:07.085810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] MFA Rules not processed for user `24d19ec6224e41519724cb8bde9f9d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:07.087127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:07.096479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.096479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.096479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.139465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] MFA Rules not processed for user `64ebb765deac481f995646724a3b3de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:07.140681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:07.225510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1057/2136] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:07.226960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.234589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1080/2137] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:07.240455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.252674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:07.326386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f20bbe-e5d4-4aa5-ba16-b5ff3a8d63d8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.332998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.333679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.333960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.334233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.334969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.338399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.380446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1058/2138] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:07.380624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b21c-b5f3-4656-b511-f713c6584860 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.383615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.457608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:07.486958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.488226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.488711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.489176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.489853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb090b-7287-42b7-a1c6-9164911555d8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.490037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.492108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.494879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.495591 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.495881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.496156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.497071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.498873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.521040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1081/2139] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:07.521250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1059/2140] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:07.524664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.525860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.537737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3b1b-0f01-47d0-9e3c-3ce0d098f9ec admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.597499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.598343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.598695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.599266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.599860 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.601013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad47d-fbb3-46ba-a506-597b276ade44 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.601614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.607030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.607918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.608239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.608548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.609245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.611676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.615391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1060/2141] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:07.618429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.629734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3b2d0-2143-4fab-ad8b-fc351ab8d95f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.635175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1082/2142] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:07.636665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.637590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.638141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.638547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.639262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.639514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.641864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.650007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f2bb-9cb6-4fc1-845d-d46c1a61f8ec admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.654759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.655245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1061/2143] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:07.655472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.655760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.656038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.656774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.658371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.659493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.669543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc6e3d-3b7a-4768-b618-765d0e9bee46 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.674468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1083/2144] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:07.676548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.686669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.687923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.688206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.688825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] PATH_INFO: `/v3/projects/2f1244f4a7db4bef8a826c1da9e5e096/users/2a8b90b9d2e745bab4ee417e7dd79761/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.690577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877ce74-ede3-40d0-a9af-0b58407da83d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.696426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.697532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.697912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.698210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:07.698343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] PATH_INFO: `/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183/users/3c0a250b766a4e8d9bf0b8dc403d10fa/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.716618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1244f4a7db4bef8a826c1da9e5e096, user_id=2a8b90b9d2e745bab4ee417e7dd79761, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.718875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7490f52d6b4a88a9a6ca19f5a21183, user_id=3c0a250b766a4e8d9bf0b8dc403d10fa, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.720328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38a8e-ca0b-48d2-a4fb-34a30ff981f3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.721905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.736445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1062/2145] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:07 2022] PUT /identity/v3/projects/2f1244f4a7db4bef8a826c1da9e5e096/users/2a8b90b9d2e745bab4ee417e7dd79761/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:07.748112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.748784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.749305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.762372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1084/2146] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:07 2022] PUT /identity/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183/users/3c0a250b766a4e8d9bf0b8dc403d10fa/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:07.766106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.778958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] MFA Rules not processed for user `2a8b90b9d2e745bab4ee417e7dd79761`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:07.780307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:07.840605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d238fa1-25d6-4a80-b201-e7c51291d3fe admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.845320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.845993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.846291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.846609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.847658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.849622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.861501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1085/2147] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:07.865838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.875416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1063/2148] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:07.880603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.882892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8dfe-b28f-4d48-ad29-af90e400d8fd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.889141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.890618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.891002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.891388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] PATH_INFO: `/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183/users/3c0a250b766a4e8d9bf0b8dc403d10fa/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.893486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea16c-b6fa-48db-a0b5-4dc32b820f6d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:07.893775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7490f52d6b4a88a9a6ca19f5a21183, user_id=3c0a250b766a4e8d9bf0b8dc403d10fa, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.897255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dd509-4314-4b52-9fb6-fb19257f8f52 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.899056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:07.899958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.900456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.900893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.902080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:07.904972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:07.905407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:07.924425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1086/2149] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:07 2022] PUT /identity/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183/users/3c0a250b766a4e8d9bf0b8dc403d10fa/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:07.928149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:07.928458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:07.928784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:07.945386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1064/2150] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:07.948968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:07.963149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] MFA Rules not processed for user `3c0a250b766a4e8d9bf0b8dc403d10fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:07.964438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:08.035143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce5fe-046b-4bbd-817e-6d04d4ff0da2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.040396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.041212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.041399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.041833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.042832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.045391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.051473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1087/2151] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:08.068667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.078274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1065/2152] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:07 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:08.079493 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.091365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe125-1563-452c-8e5e-ca18ffc3440d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.096330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.097005 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.097530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.097877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.098737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.100411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.115956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1066/2153] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:08.116215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.127790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a483496-c0e6-42c6-9dad-68cf100fdaeb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.133589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.134484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.134773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.135061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] PATH_INFO: `/v3/projects/41dfe47266504718a35a98b705e472b4/users/50ea74defa184496bcae537818f362ae/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.139296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e170c8d-cf8b-43c1-9816-87dc5663df29 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.143586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.144245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.144525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.144860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.151314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41dfe47266504718a35a98b705e472b4, user_id=50ea74defa184496bcae537818f362ae, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.154558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.155061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.156037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.166588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1088/2154] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:08.173495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1067/2155] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:08 2022] PUT /identity/v3/projects/41dfe47266504718a35a98b705e472b4/users/50ea74defa184496bcae537818f362ae/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:08.177677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.187973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc848c-40c0-43b6-a39e-b9a16ae246ff service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.259733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.260422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.260761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.261694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.262440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.264194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.275440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1089/2156] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:08.279984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.289776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.293830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfa3ae-e43f-4770-9915-68fa3ec71369 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.299585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.300560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.300949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.301230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] PATH_INFO: `/v3/projects/41dfe47266504718a35a98b705e472b4/users/50ea74defa184496bcae537818f362ae/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.303310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41dfe47266504718a35a98b705e472b4, user_id=50ea74defa184496bcae537818f362ae, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.306288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c02d-b8f1-40d7-98cf-894cf988b809 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.309781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:08.315251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:08.319830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1068/2157] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:08 2022] PUT /identity/v3/projects/41dfe47266504718a35a98b705e472b4/users/50ea74defa184496bcae537818f362ae/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:08.332247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.332544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.332830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.361148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec481-2461-416a-ae64-757dfec0e208 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.364416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] MFA Rules not processed for user `50ea74defa184496bcae537818f362ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:08.369818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:08.432120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.432946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.433319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.433741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.459699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1069/2158] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:08.505364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.506873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.516328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1090/2159] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:08.611049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:08.612885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:08.625830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcea8ff-02e9-4d37-b3f1-7d4bae700a57 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:08.630086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:08.630926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:08.631210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:08.631523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:08.641776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:08.643543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:08.654923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1070/2160] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:10.148709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:10.159074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e5ad-fb31-4f39-b7ae-28e87eb55a17 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:10.164945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:10.165698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:10.165884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:10.166169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:10.244912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:10.246585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13587ea-6fac-4ec7-bb84-6d999197ec96 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:10.258141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1091/2161] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:11.223454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:11.225655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:11.308596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429073c2-d295-4855-baaf-c19c4c851b39 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:11.313351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:11.314260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:11.314604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:11.314880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] PATH_INFO: `/v3/users/a5c66879c0b147ea8e757363bd428977` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:11.316184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c66879c0b147ea8e757363bd428977)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:11.318223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:11.374025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c66879c0b147ea8e757363bd428977'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:11.381642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c66879c0b147ea8e757363bd428977'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:11.392759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c66879c0b147ea8e757363bd428977'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:11.393575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c66879c0b147ea8e757363bd428977'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:11.399292 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:11.408980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c66879c0b147ea8e757363bd428977'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:11.417187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1071/2162] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:11 2022] DELETE /identity/v3/users/a5c66879c0b147ea8e757363bd428977 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:11.421701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:11.422150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:11.422400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:11.442997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:11.444309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:11.474987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:11.513871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1092/2163] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:11.538525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:11.540102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:11.603899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93312005-58aa-4baa-9af4-34e16172143f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:11.607981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:11.608634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:11.608936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:11.609212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:11.618869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:11.620353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:11.634222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1072/2164] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:12.034451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.036708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.054650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8a8c-9b03-4edf-961c-f340a2c47ec4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.069729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.070779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.071127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.071616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] PATH_INFO: `/v3/projects/16cc9cdae65c4becba5d6cf1098f72dc` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.072940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cc9cdae65c4becba5d6cf1098f72dc)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.075009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.149886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cc9cdae65c4becba5d6cf1098f72dc', 'request_id': 'req-e76609f4-ab84-439c-b65a-f34b5901a18f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.161167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cc9cdae65c4becba5d6cf1098f72dc', 'request_id': 'req-e76609f4-ab84-439c-b65a-f34b5901a18f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.167835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cc9cdae65c4becba5d6cf1098f72dc', 'request_id': 'req-e76609f4-ab84-439c-b65a-f34b5901a18f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.173081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.174636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.181439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] The token cache is being invalidate because project 16cc9cdae65c4becba5d6cf1098f72dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:12.181751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.182372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e76609f4-ab84-439c-b65a-f34b5901a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.184341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1093/2165] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:12 2022] DELETE /identity/v3/projects/16cc9cdae65c4becba5d6cf1098f72dc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:12.187943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5cda6-d7ac-4dbf-8ff9-ecdf3c666d4c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.188622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534222ee-ef79-42ed-83bc-fe187bd147db None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.188892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534222ee-ef79-42ed-83bc-fe187bd147db None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.189174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534222ee-ef79-42ed-83bc-fe187bd147db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.207274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-534222ee-ef79-42ed-83bc-fe187bd147db None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:12.208562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-534222ee-ef79-42ed-83bc-fe187bd147db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.245976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.246863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.247147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.247446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] PATH_INFO: `/v3/users/54ba5eab1d2f422ab255cb5260ae3ada` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.248654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ba5eab1d2f422ab255cb5260ae3ada)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.250614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.269089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1094/2166] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:12.277629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.277923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.278204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.297256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:12.298456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.306380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ba5eab1d2f422ab255cb5260ae3ada'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.306518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1095/2167] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:12.308314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.310360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.314081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ba5eab1d2f422ab255cb5260ae3ada'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.321933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ba5eab1d2f422ab255cb5260ae3ada'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.322590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ba5eab1d2f422ab255cb5260ae3ada'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.322704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3431d4-bdd3-4c58-8863-44e1c973752c None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.328102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.328981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.329263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.329537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] PATH_INFO: `/v3/users/64ebb765deac481f995646724a3b3de9` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.330835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ebb765deac481f995646724a3b3de9)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.332870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.335878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ba5eab1d2f422ab255cb5260ae3ada'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.342032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1073/2168] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:12 2022] DELETE /identity/v3/users/54ba5eab1d2f422ab255cb5260ae3ada => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:12.345003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.345003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.356213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:12.379810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:12.383128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ebb765deac481f995646724a3b3de9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.393302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ebb765deac481f995646724a3b3de9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.394014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ebb765deac481f995646724a3b3de9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.402554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ebb765deac481f995646724a3b3de9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.403279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-9fe50543-3b85-4069-ac31-91caa62bfe4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ebb765deac481f995646724a3b3de9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:12.415037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc0d3-7a60-4aa5-aa64-4b01f2d5a18c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.419768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.420439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.420724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1096/2169] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:12 2022] DELETE /identity/v3/users/64ebb765deac481f995646724a3b3de9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:12.420824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.421000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.422287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.422746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.422942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.423849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:12.424471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.426997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54feab-88bc-4ed8-a3ee-a493cae32255 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.442158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:12.442839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1074/2170] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:12.443399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.444285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.444575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.444857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.463481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:12.464843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.506744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1097/2171] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:12.507663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.508981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.526019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff2f1-3eeb-419f-9d56-aa9e2b4ee79f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.531460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.532206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.532586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.533038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.534011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.541832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.548921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1075/2172] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:12.549871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.551543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.583248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1098/2173] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:12.583248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.584856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:12.617302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bb16-d0e4-49b3-9f27-1daee6c136b5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.645204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb907-84b8-4e5e-84d4-1d2fddcd6c91 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.649889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.650554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.650848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.651120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.674431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.675108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.675422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.675702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.689660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:12.713977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:12.727819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.729968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.742921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1099/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:12.744408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.748432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.749928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.757779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b8f8-e16f-443e-a9d0-34bdc7b5a0e0 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.762552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1076/2175] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:12.764049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.764976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.765447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.765867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.766808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.769315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.799213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1100/2176] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/users => generated 291 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:12.800257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.812207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f2bc-8516-4926-bbbf-2eec8900458c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.817157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.817878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.818165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.818473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.819195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.820841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.835471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1077/2177] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:12.837565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.850187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dce1-6769-42cf-9e47-477fe4161597 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.858701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.859229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.860653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.860994 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.861693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.864602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ee1a6-7b19-4ee1-8292-1b4e6407c830 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.877522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1101/2178] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:12.881974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:12.894494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fa7ef-c53d-44dc-a87e-ae6681ca4a95 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:12.899916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:12.900496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.900775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.901079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] PATH_INFO: `/v3/projects/5ed01b7f521c413e944560db54281ebc/users/7fd8fce7c040433e908a4fe6c6b13e08/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.936949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed01b7f521c413e944560db54281ebc, user_id=7fd8fce7c040433e908a4fe6c6b13e08, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:12.942384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:12.962862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1078/2179] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:12 2022] PUT /identity/v3/projects/5ed01b7f521c413e944560db54281ebc/users/7fd8fce7c040433e908a4fe6c6b13e08/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:12.969188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:12.969537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:12.970249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:12.992209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:12.993692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:13.126160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1102/2180] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:13.146255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:13.171726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:13.173449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:13.193391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b710-e9aa-4bfb-b325-55bdba167838 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:13.205961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:13.207014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:13.207368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:13.207772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] PATH_INFO: `/v3/projects/21b1827996534d898d9fd444584977a7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:13.210702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b1827996534d898d9fd444584977a7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:13.213244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:13.261398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd0f2f-278b-4a2c-a84c-c96db787ef85 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:13.265897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:13.266703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:13.267056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:13.267510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:13.283752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:13.286457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:13.307140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1079/2181] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:13.307967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:13.309784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:13.310278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b1827996534d898d9fd444584977a7', 'request_id': 'req-4698c7ef-a312-46ec-8a28-9c57004c0117'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.316759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b1827996534d898d9fd444584977a7', 'request_id': 'req-4698c7ef-a312-46ec-8a28-9c57004c0117'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.323674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644820b-533d-452c-b81e-6a3817f024f0 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:13.323879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b1827996534d898d9fd444584977a7', 'request_id': 'req-4698c7ef-a312-46ec-8a28-9c57004c0117'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.342114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] The token cache is being invalidate because project 21b1827996534d898d9fd444584977a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:13.342616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.343515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.345541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1103/2182] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:13 2022] DELETE /identity/v3/projects/21b1827996534d898d9fd444584977a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:13.349516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:13.351866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:13.409509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:13.410547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:13.410837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:13.411125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] PATH_INFO: `/v3/projects/50d7b2fc37f8448bb3afd507ad22538d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:13.412416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d7b2fc37f8448bb3afd507ad22538d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:13.414701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:13.428869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:13.441552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:13.451105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698c7ef-a312-46ec-8a28-9c57004c0117 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:13.457547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:13.458438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:13.458702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:13.459198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] PATH_INFO: `/v3/users/2dc086cec8c34089a4e68a483a3d371d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:13.460918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc086cec8c34089a4e68a483a3d371d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:13.463001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:13.477462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d7b2fc37f8448bb3afd507ad22538d', 'request_id': 'req-352718cb-2d1d-412f-b4e5-9991d51464a9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.486602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d7b2fc37f8448bb3afd507ad22538d', 'request_id': 'req-352718cb-2d1d-412f-b4e5-9991d51464a9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.494217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d7b2fc37f8448bb3afd507ad22538d', 'request_id': 'req-352718cb-2d1d-412f-b4e5-9991d51464a9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.513966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] The token cache is being invalidate because project 50d7b2fc37f8448bb3afd507ad22538d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:13.514298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.515020 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.519255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1080/2183] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:13 2022] DELETE /identity/v3/projects/50d7b2fc37f8448bb3afd507ad22538d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:13.523236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:13.524685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:13.537745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc086cec8c34089a4e68a483a3d371d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.546072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc086cec8c34089a4e68a483a3d371d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.546894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc086cec8c34089a4e68a483a3d371d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.557243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc086cec8c34089a4e68a483a3d371d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.557954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc086cec8c34089a4e68a483a3d371d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.578865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1104/2184] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:13 2022] DELETE /identity/v3/users/2dc086cec8c34089a4e68a483a3d371d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:13.608648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352718cb-2d1d-412f-b4e5-9991d51464a9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:13.716155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:13.717628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:13.718530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:13.719061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] PATH_INFO: `/v3/users/3c0a250b766a4e8d9bf0b8dc403d10fa` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:13.720766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0a250b766a4e8d9bf0b8dc403d10fa)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:13.723596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:13.792317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0a250b766a4e8d9bf0b8dc403d10fa'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.802028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0a250b766a4e8d9bf0b8dc403d10fa'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.804139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:13.813693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0a250b766a4e8d9bf0b8dc403d10fa'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.816084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0a250b766a4e8d9bf0b8dc403d10fa'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.835909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0ab353c2-6c77-4d7b-a1a9-5f7f0c905552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0a250b766a4e8d9bf0b8dc403d10fa'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:13.841873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1081/2185] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:13 2022] DELETE /identity/v3/users/3c0a250b766a4e8d9bf0b8dc403d10fa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:14.024710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.026502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.043461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d685f6-3428-401a-9587-4bf0dc0d7f7b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.057926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.058386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.058771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.100308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] MFA Rules not processed for user `7fd8fce7c040433e908a4fe6c6b13e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:14.102032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.148169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.149164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.149382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.150261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] PATH_INFO: `/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.151519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7eda3f6478d45a5b86cd1525452c2e0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.153563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.231212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1082/2186] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:14.231878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7eda3f6478d45a5b86cd1525452c2e0', 'request_id': 'req-c7d79c78-abb7-426e-a589-0f1212de98a6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.239572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7eda3f6478d45a5b86cd1525452c2e0', 'request_id': 'req-c7d79c78-abb7-426e-a589-0f1212de98a6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.243745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.245613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.247794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7eda3f6478d45a5b86cd1525452c2e0', 'request_id': 'req-c7d79c78-abb7-426e-a589-0f1212de98a6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.251646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:14.275996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] The token cache is being invalidate because project d7eda3f6478d45a5b86cd1525452c2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:14.276263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.278570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c7d79c78-abb7-426e-a589-0f1212de98a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.293599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1105/2187] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:14 2022] DELETE /identity/v3/projects/d7eda3f6478d45a5b86cd1525452c2e0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:14.297454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.297752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.299816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.330681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:14.330859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.347189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b5f0-68e4-4fa1-8f43-de75ea9d714c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.411590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1106/2188] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:14.414454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.416745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.425728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.426369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.426644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.426922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.428858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.431758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93483e6f-4d68-4c67-8840-c7391bc5566d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.436958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.437908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.438255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.438685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] PATH_INFO: `/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.440089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7490f52d6b4a88a9a6ca19f5a21183)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.442311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.467655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:14.500646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7490f52d6b4a88a9a6ca19f5a21183', 'request_id': 'req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.501291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.504194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8bd7f-c180-4d8e-80ea-30284213d1a5 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.506831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7490f52d6b4a88a9a6ca19f5a21183', 'request_id': 'req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.514007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7490f52d6b4a88a9a6ca19f5a21183', 'request_id': 'req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.518108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1083/2189] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:14.519765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.520048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.520332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.531058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] The token cache is being invalidate because project fc7490f52d6b4a88a9a6ca19f5a21183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:14.531594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.532443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f9215d92-ae5a-432c-b5ee-a5a35e13adc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:14.534205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1107/2190] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:14 2022] DELETE /identity/v3/projects/fc7490f52d6b4a88a9a6ca19f5a21183 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:14.539311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.539643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.539921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.544713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:14.546702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.566246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:14.567529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.632710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1108/2191] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:14.633638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.635067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.637033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1084/2192] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:14.638067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.649421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015df246-641c-42ed-a2ae-9b753c926c81 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.654251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.654923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.655207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.655524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.656478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:14.656610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.658213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6554f46-9496-4b27-bb86-ceab9f85db7e admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.665068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:14.670831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1085/2193] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:14.673555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.675108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.676061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.698177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:14.699434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.709456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1086/2194] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:14.713482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.716556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350c1d6-4e67-4afd-a019-ba833b03cd65 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.720722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.721411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.721719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.721989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.724880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:14.725120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471f27-b322-4d27-b629-b4b0c6871042 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.729835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.730485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.730762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.731035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.732284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.736015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.771464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1087/2195] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:14.771464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.794319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.796490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.822713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1109/2196] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:14.824158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.837818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc130-f217-4756-91c6-37500551bd97 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.861796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29238a30-bf21-45aa-a66c-4a186f2327fa admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.875765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.876500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.876774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.877052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.878702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:14.879190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.881170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.918254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1088/2197] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:14.921510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.942152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.943031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.943369 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.943772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.943908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdadaf-1981-411b-9aaa-3010f7702dcf admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.944714 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.946941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.951151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.952140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.952512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.952789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.953514 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.955673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.972398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1110/2198] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:14.976489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:14.988573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568e17-219d-4666-8096-a74f6cdbbc2e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:14.993876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:14.994638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:14.994902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:14.995195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:14.995540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1089/2199] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:14.996087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:14.997856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:14.999606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.006808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.009730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1111/2200] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:15.013571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.030290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f781da-2499-4bfd-8810-089f8c7240d4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.077793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a8e9-d7ff-4914-9e05-8bd6734b1482 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.083851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.084812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.084993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.085614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.087702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.087889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.096835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.119258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.120002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.120372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.120783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.124340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.124485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1090/2201] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:14 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:15.125988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.139840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1112/2202] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:15.140045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.141775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.151730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe94f-05d1-4bf9-8d2b-93196cc88e52 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.154141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149094c8-f9dd-49c1-a3b5-af6d18218a0c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.156899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.157630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.157912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.158189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.159215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.159389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.160322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.160605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.160700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.161000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] PATH_INFO: `/v3/projects/19606aabf0ff4938949f73785228d403/users/45f02970756e4ba0a2199b892b3453eb/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.172651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1091/2203] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:15.177295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.178683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19606aabf0ff4938949f73785228d403, user_id=45f02970756e4ba0a2199b892b3453eb, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.181384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0b4be-8cc5-431f-bce0-0e3a483bcff8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.189201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd73362-a90c-4070-bef4-75c5fb589d5f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.196581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1113/2204] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:15 2022] PUT /identity/v3/projects/19606aabf0ff4938949f73785228d403/users/45f02970756e4ba0a2199b892b3453eb/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:15.208380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452a2a-261b-4a97-aacf-838cb7e04dd7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.208661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452a2a-261b-4a97-aacf-838cb7e04dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.209385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452a2a-261b-4a97-aacf-838cb7e04dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.244101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-57452a2a-261b-4a97-aacf-838cb7e04dd7 None None] MFA Rules not processed for user `45f02970756e4ba0a2199b892b3453eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:15.246168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-57452a2a-261b-4a97-aacf-838cb7e04dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.259791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.263907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.264257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.264691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.265545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.267188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.278877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1092/2205] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:15.283450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.299095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2ad5-42d6-4f36-a96f-47a911d92a16 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.307946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.309499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.310157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.310439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] PATH_INFO: `/v3/projects/25e675ed974a49aface7752a394e57d0/users/855a07661b304ab899eb6e4cd9f37020/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.341224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e675ed974a49aface7752a394e57d0, user_id=855a07661b304ab899eb6e4cd9f37020, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.344497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1114/2206] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:15.345099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.363663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1093/2207] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:15 2022] PUT /identity/v3/projects/25e675ed974a49aface7752a394e57d0/users/855a07661b304ab899eb6e4cd9f37020/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:15.379661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.380055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.380556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.385897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.388074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.413176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] MFA Rules not processed for user `855a07661b304ab899eb6e4cd9f37020`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:15.414476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.483648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ff26-9d75-4cf3-9845-792d3823f51a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.490296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.490963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.491248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.491559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.506894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.515595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1115/2208] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:15.521344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.568858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.570744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.571951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.583165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1094/2209] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:15.598030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df830de-3dff-426b-95ac-8ab9b28ce4de None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.598963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.602680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.603779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.604242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.604741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.606897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.609666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.610973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad011c-fe6d-442a-81ec-094cd8b44685 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.618432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.619327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.619655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.619932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] PATH_INFO: `/v3/users/45f02970756e4ba0a2199b892b3453eb` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.621310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f02970756e4ba0a2199b892b3453eb)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.623367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.643462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1116/2210] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:15.645337 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.681157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f02970756e4ba0a2199b892b3453eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:15.689680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f02970756e4ba0a2199b892b3453eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:15.698489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f02970756e4ba0a2199b892b3453eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:15.699565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f02970756e4ba0a2199b892b3453eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:15.714319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-20a02013-3a0c-447b-bcc4-b4cf7acec8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f02970756e4ba0a2199b892b3453eb'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:15.720960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1095/2211] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:15 2022] DELETE /identity/v3/users/45f02970756e4ba0a2199b892b3453eb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:15.725534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.725852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.726131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.726676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153883-6ed8-4399-ab27-8a98ade13545 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.743925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:15.745124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.786734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.787502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.787786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.788067 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.788792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.790911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.811961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1096/2212] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:15.817200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1117/2213] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:15.820458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.821857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.822068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.823565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.834522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84fb2-aab4-4a11-a214-e84b079a8171 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.839545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.840257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.840685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.840822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.841523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.843153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.853782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1097/2214] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:15.857903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.868284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631b49-f9a9-4cd1-b7a8-8cc314026e0c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.873253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.874172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.874426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.874706 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] PATH_INFO: `/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d/users/7a891d33425648f79e601372376e9f17/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.887826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.897951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f4b2515c54e2aa7b94bb1c86b834d, user_id=7a891d33425648f79e601372376e9f17, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.901891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba016c-56b8-4e9f-bc91-a98512081508 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.902774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.910258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.911126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.911627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.912128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.919305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1098/2215] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:15 2022] PUT /identity/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d/users/7a891d33425648f79e601372376e9f17/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:15.923441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:15.926698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:15.928283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c9b04-2ddd-4a74-9a5a-d6776f9588d6 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:15.947709 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1118/2216] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:15.949007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0312-15f3-4a40-a78d-c80d64a154b8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.949298 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0312-15f3-4a40-a78d-c80d64a154b8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.949578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0312-15f3-4a40-a78d-c80d64a154b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.964862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:15.971389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2bda0312-15f3-4a40-a78d-c80d64a154b8 None None] MFA Rules not processed for user `7fd8fce7c040433e908a4fe6c6b13e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:15.973251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2bda0312-15f3-4a40-a78d-c80d64a154b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:15.992907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11e55-e9e2-4775-94c5-e685e29eebda admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:15.997770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:15.998472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:15.998756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:15.999030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:15.999846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.001773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.018903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1099/2217] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:16.020158 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.032078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827acb-1c80-4d7c-9093-84303dfae400 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.039091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.040073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.040364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.040701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] PATH_INFO: `/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d/users/7a891d33425648f79e601372376e9f17/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.043040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f4b2515c54e2aa7b94bb1c86b834d, user_id=7a891d33425648f79e601372376e9f17, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.045897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.048619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1119/2218] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:16.064280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1100/2219] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:16 2022] PUT /identity/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d/users/7a891d33425648f79e601372376e9f17/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:16.077426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.077930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.078486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.117961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] MFA Rules not processed for user `7a891d33425648f79e601372376e9f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:16.119271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.229741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1120/2220] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:16.241006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.242993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.290563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.292275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.330118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a8be-b513-4b2e-aab3-a95104f99632 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.336904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.337892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.338558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.338558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.342663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.372187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1115-621f-4337-9213-432f4fcf6eee None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.378166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.379556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.380383 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.380839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] PATH_INFO: `/v3/projects/19606aabf0ff4938949f73785228d403` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.382642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19606aabf0ff4938949f73785228d403)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.385218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.422934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.424607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995090f5-f216-4142-ba54-555a6629968c service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.434910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1101/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:16.437596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:16.447609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19606aabf0ff4938949f73785228d403', 'request_id': 'req-c0d97a09-9a93-4ed7-9468-432f55fa5614'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:16.455876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19606aabf0ff4938949f73785228d403', 'request_id': 'req-c0d97a09-9a93-4ed7-9468-432f55fa5614'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:16.463702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19606aabf0ff4938949f73785228d403', 'request_id': 'req-c0d97a09-9a93-4ed7-9468-432f55fa5614'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:16.480856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] The token cache is being invalidate because project 19606aabf0ff4938949f73785228d403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:16.480856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:16.481787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-c0d97a09-9a93-4ed7-9468-432f55fa5614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:16.483769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1121/2222] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:16 2022] DELETE /identity/v3/projects/19606aabf0ff4938949f73785228d403 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:16.488667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.489133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.489352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.509323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:16.511014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.544663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:16.590806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1102/2223] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:16.599556 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.600035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.600339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.624548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:16.625888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:16.638234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1122/2224] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:16.639764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.649981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e30af-6f39-4e18-b69a-8894c4fd83f3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.660818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.661601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.661954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.662301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.663146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:16.663559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.665322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.679421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1103/2225] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:16.683186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.693635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace266d9-562e-43e1-91d9-cdcbc61627ee None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.698822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.699541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.699897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.700215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.701021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.703139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.749112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1123/2226] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:16 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:16.750510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.761980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2174b1-1e77-431e-a68c-fac66cf964a8 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.856534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.857243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.857533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.857834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.858517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.862501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.920113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1104/2227] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:16 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:16.921966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.938278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7864d9-9c17-4506-bc24-c70b8ad7bd0d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:16.943504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:16.944334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:16.944737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:16.945650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:16.947227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:16.949133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:16.974481 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1124/2228] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:16.979096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:16.996662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b493-b43a-46c4-83cc-1fd154948b7d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:17.009798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:17.010889 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.011537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.012095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.013688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:17.016883 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d320-d6eb-4042-85d4-9b492bef65fd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:17.029844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1105/2229] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:17.034216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:17.051794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb2b78-61c3-4532-9bf0-5a14880f83e4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:17.065918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:17.068448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.070855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.071249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] PATH_INFO: `/v3/projects/623abf1c23344568b2b0077b37402cde/users/58e3fff2c4164c68bad9cc5ce456a5d9/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.115808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623abf1c23344568b2b0077b37402cde, user_id=58e3fff2c4164c68bad9cc5ce456a5d9, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:17.121754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:17.154749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.154883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1125/2230] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:17 2022] PUT /identity/v3/projects/623abf1c23344568b2b0077b37402cde/users/58e3fff2c4164c68bad9cc5ce456a5d9/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:17.156000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.156942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.200091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] MFA Rules not processed for user `58e3fff2c4164c68bad9cc5ce456a5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:17.201466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:17.283465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1106/2231] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:17.329338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:17.331525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:17.444906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:17.446768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:17.461875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d53e7-835c-4275-b431-dff79b500d57 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:17.467281 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:17.469083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.469466 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.469905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.477921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:17.480814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:17.482479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125740-7600-42b3-b906-3051b11d21a0 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:17.493410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1126/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:17.545636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64898fe-6995-4169-884e-fc0f68883a34 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:17.552633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:17.553981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.554399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.554925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] PATH_INFO: `/v3/users/24d19ec6224e41519724cb8bde9f9d9c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.556445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d19ec6224e41519724cb8bde9f9d9c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:17.558816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:17.626454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d19ec6224e41519724cb8bde9f9d9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:17.633900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d19ec6224e41519724cb8bde9f9d9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:17.641353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d19ec6224e41519724cb8bde9f9d9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:17.642054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d19ec6224e41519724cb8bde9f9d9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:17.655082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d19ec6224e41519724cb8bde9f9d9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:17.662113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1107/2233] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:17 2022] DELETE /identity/v3/users/24d19ec6224e41519724cb8bde9f9d9c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:17.666811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.667377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.667377 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.685003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:17.686245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:17.746678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1127/2234] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:17.757011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:17.758664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:17.825788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963e6a1-824f-4f9d-ae12-12af2e3e0952 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:17.829413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:17.830065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:17.830346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:17.830619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:17.840490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:17.841950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:17.852648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1108/2235] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:18.159257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:18.160989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:18.176238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c624d3-459e-4555-8a57-5d8c85555236 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:18.178782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:18.179755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:18.179996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:18.180429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] PATH_INFO: `/v3/projects/be1d6f7297c148ba8a5381684079c443` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:18.182226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1d6f7297c148ba8a5381684079c443)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:18.185991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:18.187697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:18.255637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1d6f7297c148ba8a5381684079c443', 'request_id': 'req-f4a79182-8fef-4363-a63f-26d42a533bb2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.261940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1d6f7297c148ba8a5381684079c443', 'request_id': 'req-f4a79182-8fef-4363-a63f-26d42a533bb2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.268718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1d6f7297c148ba8a5381684079c443', 'request_id': 'req-f4a79182-8fef-4363-a63f-26d42a533bb2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.285612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] The token cache is being invalidate because project be1d6f7297c148ba8a5381684079c443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:18.285908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.286718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.290236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1128/2236] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:18 2022] DELETE /identity/v3/projects/be1d6f7297c148ba8a5381684079c443 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:18.297341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:18.310519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785676fd-b0ed-454d-a4dd-cb365c06e892 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:18.378022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:18.406409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:18.407624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:18.407904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:18.408192 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] PATH_INFO: `/v3/users/2a8b90b9d2e745bab4ee417e7dd79761` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:18.409804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8b90b9d2e745bab4ee417e7dd79761)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:18.413944 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:18.482760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8b90b9d2e745bab4ee417e7dd79761'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.490421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8b90b9d2e745bab4ee417e7dd79761'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.511911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8b90b9d2e745bab4ee417e7dd79761'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.512556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8b90b9d2e745bab4ee417e7dd79761'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.526964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8b90b9d2e745bab4ee417e7dd79761'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:18.532983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1109/2237] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:18 2022] DELETE /identity/v3/users/2a8b90b9d2e745bab4ee417e7dd79761 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:18.927193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:18.928850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:18.942571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a79182-8fef-4363-a63f-26d42a533bb2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:19.013071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:19.013947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:19.014231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:19.014803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] PATH_INFO: `/v3/projects/2f1244f4a7db4bef8a826c1da9e5e096` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:19.015998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1244f4a7db4bef8a826c1da9e5e096)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:19.018946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:19.068103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1244f4a7db4bef8a826c1da9e5e096', 'request_id': 'req-64d10247-164c-414d-9e86-1ed062dc41a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.073758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1244f4a7db4bef8a826c1da9e5e096', 'request_id': 'req-64d10247-164c-414d-9e86-1ed062dc41a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.081294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1244f4a7db4bef8a826c1da9e5e096', 'request_id': 'req-64d10247-164c-414d-9e86-1ed062dc41a5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.099491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] The token cache is being invalidate because project 2f1244f4a7db4bef8a826c1da9e5e096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:19.099781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.100432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.102015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1129/2238] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:18 2022] DELETE /identity/v3/projects/2f1244f4a7db4bef8a826c1da9e5e096 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:19.106026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:19.107485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:19.120309 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9f45e-4947-4f1d-843d-222206c0d067 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:19.191536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:19.192414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:19.192752 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:19.192959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] PATH_INFO: `/v3/users/50ea74defa184496bcae537818f362ae` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:19.194203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ea74defa184496bcae537818f362ae)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:19.196421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:19.255677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ea74defa184496bcae537818f362ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.268556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ea74defa184496bcae537818f362ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.277945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ea74defa184496bcae537818f362ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.279304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ea74defa184496bcae537818f362ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.281024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:19.297781 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-621e85c8-3849-4ee3-8147-860dda59f8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ea74defa184496bcae537818f362ae'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.306113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1110/2239] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:19 2022] DELETE /identity/v3/users/50ea74defa184496bcae537818f362ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:19.644816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:19.648129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:19.666763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10247-164c-414d-9e86-1ed062dc41a5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:19.709770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:19.790033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:19.791092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:19.791571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:19.792112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] PATH_INFO: `/v3/projects/41dfe47266504718a35a98b705e472b4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:19.798821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41dfe47266504718a35a98b705e472b4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:19.804583 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:19.922301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41dfe47266504718a35a98b705e472b4', 'request_id': 'req-ec9de1b3-be7c-4358-b515-71b4f12e0529'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.937237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41dfe47266504718a35a98b705e472b4', 'request_id': 'req-ec9de1b3-be7c-4358-b515-71b4f12e0529'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.960715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41dfe47266504718a35a98b705e472b4', 'request_id': 'req-ec9de1b3-be7c-4358-b515-71b4f12e0529'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.985939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] The token cache is being invalidate because project 41dfe47266504718a35a98b705e472b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:19.986422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.987289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ec9de1b3-be7c-4358-b515-71b4f12e0529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:19.989349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1130/2240] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:19 2022] DELETE /identity/v3/projects/41dfe47266504718a35a98b705e472b4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:19.996986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:19.997492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:19.998202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.024656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:20.025819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.107784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1111/2241] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:20.116364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.116657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.116940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.137625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:20.138844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.147256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1131/2242] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:20.151739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.162998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42061-8d7a-4a61-93b6-ccda3b5ef16d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.167633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.168299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.168586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.168863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.169617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:20.170092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.171759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.183746 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1112/2243] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:20.188978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.198408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e052bf-9dd6-4903-a70c-d356114cceeb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.203161 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.203846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.204126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.204399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.205108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.207094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.237216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1132/2244] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:20.242049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.263433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e262-3c1d-47f1-96b6-2ebdb8538974 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.328819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.329500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.329819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.330102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.330818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.332855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.357096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1113/2245] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:20.358268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.368628 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073520c0-17f4-42e8-aedb-bca4bdf0571d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.373921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.374577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.374853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.375121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.375873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.377477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.388193 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1133/2246] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:20.392301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.402826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01f27-13d3-40b7-aed8-fc87ac63a8b3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.412473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.413298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.413377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.413681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.414411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.416182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859da03-8ff5-4aed-a4e6-637b7306eab3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.428012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1114/2247] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:20.433108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.457438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73681-670f-4173-a05b-aa44b5889456 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.474710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.475691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.475975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.476251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] PATH_INFO: `/v3/projects/8b973f1d0fdb484f9a2e5f17ec969cb1/users/d3d13c5b2b4e4f158ff76663d9d19d4f/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.495444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b973f1d0fdb484f9a2e5f17ec969cb1, user_id=d3d13c5b2b4e4f158ff76663d9d19d4f, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.498080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.517310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1134/2248] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:20 2022] PUT /identity/v3/projects/8b973f1d0fdb484f9a2e5f17ec969cb1/users/d3d13c5b2b4e4f158ff76663d9d19d4f/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:20.529102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.529468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.529794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.564021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] MFA Rules not processed for user `d3d13c5b2b4e4f158ff76663d9d19d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:20.565937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.618647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:20.660440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1115/2249] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:20.664877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.725095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:20.745339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.746934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.756563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea47ae-f42e-4377-b568-8e37ac3479da admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.765057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca9d36-9b10-4cef-88d5-28113d9f0455 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.766301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.767651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.767947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.768224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.768940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.771035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.776432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.777768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.778286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.778764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] PATH_INFO: `/v3/users/58e3fff2c4164c68bad9cc5ce456a5d9` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.780352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e3fff2c4164c68bad9cc5ce456a5d9)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.782548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.800215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1135/2250] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:20.805082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.847558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e3fff2c4164c68bad9cc5ce456a5d9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:20.855802 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e3fff2c4164c68bad9cc5ce456a5d9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:20.865012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e3fff2c4164c68bad9cc5ce456a5d9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:20.865709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e3fff2c4164c68bad9cc5ce456a5d9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:20.875542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145b1e5-82dc-4d29-98b9-a797967e0fa5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.880138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d2f52139-2585-4b91-9fe9-469de64badd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e3fff2c4164c68bad9cc5ce456a5d9'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:20.880340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:20.881053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.881335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.881736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.882435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:20.884480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:20.888504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1116/2251] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:20 2022] DELETE /identity/v3/users/58e3fff2c4164c68bad9cc5ce456a5d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:20.892775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:20.893057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:20.893332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:20.909053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1136/2252] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:20.912830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:20.914922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:20.915454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.916176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:20.928781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596bc2-5d2f-4e03-98da-84642c377883 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:20.995398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1117/2253] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:21.001875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.002618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.002908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.003185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.004013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.005697 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.010007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.014416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.022875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1137/2254] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:21.026993 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.051797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dabad-2877-4ddc-8c57-77894be54196 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.058611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.059555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.059838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.060114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] PATH_INFO: `/v3/projects/be55749c2bf442c39fb58eca8761ba53/users/15a8bddb7b4441cdbc11900026abd8ae/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.116402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be55749c2bf442c39fb58eca8761ba53, user_id=15a8bddb7b4441cdbc11900026abd8ae, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.118936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.122427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:21.126593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003badd2-ca1e-4df8-a9f6-47bb6cce8102 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.131723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.132581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.132848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.133126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.143130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1138/2255] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:21 2022] PUT /identity/v3/projects/be55749c2bf442c39fb58eca8761ba53/users/15a8bddb7b4441cdbc11900026abd8ae/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:21.144663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.145566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.147881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.148783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.163578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1118/2256] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:21.165235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.180140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad847f0-8d62-4a2a-8678-dcce34225563 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.209520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:21.240124 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69132f0-6be2-43b0-b27a-724c9ac5d5b0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.244985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.245648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.245938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.246215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.249649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.302171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.302852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.303296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.303608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.305410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.307435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.323466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1119/2257] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:21.327656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.340606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dcfd-c0eb-4365-bcba-b7ff9c058566 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.352188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.354026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48369b-e0d8-46dd-b3bc-d8d814965b95 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.354603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.355797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.356264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.356730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] PATH_INFO: `/v3/projects/be55749c2bf442c39fb58eca8761ba53/users/15a8bddb7b4441cdbc11900026abd8ae/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.359597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=be55749c2bf442c39fb58eca8761ba53, user_id=15a8bddb7b4441cdbc11900026abd8ae, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.362978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.377141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1139/2258] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:21.383566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1120/2259] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:21 2022] PUT /identity/v3/projects/be55749c2bf442c39fb58eca8761ba53/users/15a8bddb7b4441cdbc11900026abd8ae/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:21.395126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.395508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.395849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.428336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] MFA Rules not processed for user `15a8bddb7b4441cdbc11900026abd8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:21.429737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.578794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1140/2260] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:21.591628 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.593373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.675272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb7d0-0d1e-453c-88ac-918e6f1c91ad admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.680686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.681623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.681999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.682331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.696457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:21.696980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:21.714113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1121/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:21.820980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.843685 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac76fb-63f4-44ca-9105-975448a8b2a7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:21.852264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:21.853305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:21.853932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:21.854640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:21.859702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:21.922447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:21.924062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:22.004790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.010940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aacb0-58dd-42cc-8826-20debda87f02 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.026799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1141/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:22.085604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c07851-bf50-4309-8588-add38dfb55f5 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.102783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.103728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.104068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.104476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] PATH_INFO: `/v3/projects/623abf1c23344568b2b0077b37402cde` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.105789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623abf1c23344568b2b0077b37402cde)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.108465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.183637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:22.250771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623abf1c23344568b2b0077b37402cde', 'request_id': 'req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:22.268014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623abf1c23344568b2b0077b37402cde', 'request_id': 'req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:22.275025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623abf1c23344568b2b0077b37402cde', 'request_id': 'req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:22.290278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] The token cache is being invalidate because project 623abf1c23344568b2b0077b37402cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:22.290970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:22.291296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-99c4a1c1-3fb2-4cc4-9b2f-e96373f885d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:22.293336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1122/2263] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:21 2022] DELETE /identity/v3/projects/623abf1c23344568b2b0077b37402cde => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:22.299494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.300911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.301450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.340720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:22.358793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:22.360479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:22.526733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1142/2264] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:22.536697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.536984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.537396 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.571465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:22.574099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:22.606004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1123/2265] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:22.606755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.621665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bfec7-12b3-48b4-a382-69bd61dfe3aa None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.633676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.634560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.635059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.635363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.636326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:22.636837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.639812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.661773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.664865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1143/2266] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:41:22.675393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29d5f9-96aa-4f63-97eb-9631159f5076 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.680423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.681477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.681894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.682268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.683181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.685667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.751792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1124/2267] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:22 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:22.753072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.764701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459b6c-9b7f-4861-9fdb-3c95152b2ab5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.823233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.823944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.824268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.824564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.825276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.827158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.849253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1144/2268] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:22 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:22.853828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.864679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c592-78d0-4768-a308-d8be7f5cf2ab admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.869429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.870091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.870370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.870646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.871466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.873088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.884377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1125/2269] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:22.888350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.898821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b07f2-bd8c-4343-a6f2-917bf7d836e9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.903527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.904186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.904467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.904867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.905465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.907228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d0d7b-5dbd-4439-bd54-9f6c2a678792 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.918315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1145/2270] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:22.923137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:22.935809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88eee5-00df-4e7d-bf97-e74047418bcb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:22.941539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:22.942438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.943043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.943043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] PATH_INFO: `/v3/projects/2a38ac8352614a7ea09a3cc364f0dc42/users/a3bd7317600b4d98b40b036669ce9e16/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:22.964203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a38ac8352614a7ea09a3cc364f0dc42, user_id=a3bd7317600b4d98b40b036669ce9e16, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:22.966996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:22.982624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1126/2271] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:22 2022] PUT /identity/v3/projects/2a38ac8352614a7ea09a3cc364f0dc42/users/a3bd7317600b4d98b40b036669ce9e16/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:22.993037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:22.993329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:22.993919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.025974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] MFA Rules not processed for user `a3bd7317600b4d98b40b036669ce9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:23.027196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:23.113881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1146/2272] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:23.118565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.195737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163ad93-16df-4b0a-b65e-41532d2f8f69 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.201205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.202165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.202447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.202724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.203500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.205509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.243378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1127/2273] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:23 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:23.246591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.254661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:23.264730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a705f-5e86-45c4-93c0-02e2fe5e1f31 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.343461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.344428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.344704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.345033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.345695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.347719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.370810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1147/2274] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:23 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:23.373417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.384364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2240-b084-449c-af2a-17aee5d6abe3 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.389854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.390517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.390815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.391128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.391928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.393547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.404276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1128/2275] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:23.408557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.418446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc0e6-e60b-4d16-b6dd-ad5d53c24459 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.423469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.424059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.424338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.424620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.425326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.426928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a87b24-bdfd-4178-9918-0938a9f888be admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.437300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1148/2276] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:23.441561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.451636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8f5e3-7020-4f87-9198-6d91009ddb46 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.456451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.457345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.457620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.457881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] PATH_INFO: `/v3/projects/6c3059dc31b847aa9997667456cf0508/users/bfc24e5561e040038b1f0a413a18f1d1/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.473898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3059dc31b847aa9997667456cf0508, user_id=bfc24e5561e040038b1f0a413a18f1d1, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.476677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.478976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:23.493232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1129/2277] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:23 2022] PUT /identity/v3/projects/6c3059dc31b847aa9997667456cf0508/users/bfc24e5561e040038b1f0a413a18f1d1/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:23.505830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.513463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.513897 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.542463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] MFA Rules not processed for user `bfc24e5561e040038b1f0a413a18f1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:23.544035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:23.616938 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1149/2278] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:23.621076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.699180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc3-b350-472a-bc05-63ec045ba912 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.704880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.705562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.705848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.706122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.706953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.708933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.759744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1130/2279] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:23 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:23.764169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.781147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02444f-722c-4919-9953-c1c49e4c7cd9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.866925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.867824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.868114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.868392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.869115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.872882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.902524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:23.912551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1150/2280] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:23 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:23.916483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.929742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6f38-985d-44e6-b39b-3e3537a4ae91 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.937041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.938593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.939139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.939690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:23.941218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:23.943197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:23.961965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1131/2281] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:23.965792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:23.976784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d8ef-442a-4203-a161-d163e92aa364 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:23.981529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:23.982451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:23.982734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:23.983015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] PATH_INFO: `/v3/projects/5843aecc3cb44442bfe7dc4c57db22de/users/22cd6e6335f1434eb2e6746d5e59243d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:24.002839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5843aecc3cb44442bfe7dc4c57db22de, user_id=22cd6e6335f1434eb2e6746d5e59243d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:24.006459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:24.021966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1151/2282] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:23 2022] PUT /identity/v3/projects/5843aecc3cb44442bfe7dc4c57db22de/users/22cd6e6335f1434eb2e6746d5e59243d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:24.026794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:24.038474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332a45-0ddf-42c9-a8a9-75e77b4fc9a4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:24.101451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:24.102129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:24.102414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:24.102692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:24.108953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:24.108953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615bed1-1c69-4c50-9cc6-524d9d7f5365 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:24.119816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1132/2283] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:24.120959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:24.132411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9064-1682-4d96-8956-b2988c6750cb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:24.137449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:24.138368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:24.138648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:24.138918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] PATH_INFO: `/v3/projects/5843aecc3cb44442bfe7dc4c57db22de/users/22cd6e6335f1434eb2e6746d5e59243d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:24.140977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5843aecc3cb44442bfe7dc4c57db22de, user_id=22cd6e6335f1434eb2e6746d5e59243d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:24.143936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:24.156256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1152/2284] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:24 2022] PUT /identity/v3/projects/5843aecc3cb44442bfe7dc4c57db22de/users/22cd6e6335f1434eb2e6746d5e59243d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:24.166489 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852881c4-036f-4100-9dcc-761aa317676d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:24.166784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852881c4-036f-4100-9dcc-761aa317676d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:24.167086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852881c4-036f-4100-9dcc-761aa317676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:24.194755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-852881c4-036f-4100-9dcc-761aa317676d None None] MFA Rules not processed for user `22cd6e6335f1434eb2e6746d5e59243d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:24.195945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-852881c4-036f-4100-9dcc-761aa317676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:24.250504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:24.272244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1133/2285] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:24.284021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:24.286480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:24.348183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6ca8-004d-4a67-b08b-704b1d12fcef admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:24.351882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:24.352553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:24.352832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:24.353181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:24.432618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:24.432618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:24.444008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1153/2286] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:25.948563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852881c4-036f-4100-9dcc-761aa317676d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:25.950357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-852881c4-036f-4100-9dcc-761aa317676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:25.963565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852881c4-036f-4100-9dcc-761aa317676d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:25.967575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:25.968373 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:25.968773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:25.969126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.034707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.036517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:26.045691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1134/2287] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:26.472633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:26.474343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.563024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afaccf-5280-4a0d-b6d1-5c4a79189a96 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:26.569126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:26.570133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.570569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.570894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] PATH_INFO: `/v3/users/d3d13c5b2b4e4f158ff76663d9d19d4f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.572306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d13c5b2b4e4f158ff76663d9d19d4f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.574280 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:26.609854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:26.632027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:26.634857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.651125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d13c5b2b4e4f158ff76663d9d19d4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.658379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d13c5b2b4e4f158ff76663d9d19d4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.659093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d13c5b2b4e4f158ff76663d9d19d4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.659648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027127-9a28-4871-960a-fb180bde14b3 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:26.664798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:26.665937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.666239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.666563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] PATH_INFO: `/v3/users/855a07661b304ab899eb6e4cd9f37020` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.668121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855a07661b304ab899eb6e4cd9f37020)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.668919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d13c5b2b4e4f158ff76663d9d19d4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.669613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d13c5b2b4e4f158ff76663d9d19d4f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.670334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:26.687648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1154/2288] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:26 2022] DELETE /identity/v3/users/d3d13c5b2b4e4f158ff76663d9d19d4f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:26.688580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:26.690035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.720769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855a07661b304ab899eb6e4cd9f37020'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.727737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855a07661b304ab899eb6e4cd9f37020'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.735943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855a07661b304ab899eb6e4cd9f37020'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.736561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855a07661b304ab899eb6e4cd9f37020'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.747055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc1be2-f1ac-4a66-8727-e7d6ffb4360f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:26.749234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-03ea485e-c948-4972-8a13-027b47657c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855a07661b304ab899eb6e4cd9f37020'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:26.751524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:26.751706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.752080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.752486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.754626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.758118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1135/2289] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:26 2022] DELETE /identity/v3/users/855a07661b304ab899eb6e4cd9f37020 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:26.759594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.759887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.760166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.777680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:26.778902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.822745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.824438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73225-8225-42e8-a4db-430379e75c0d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:26.834304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:26.834457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1155/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:26.849318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1136/2291] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:26.850114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.850864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.851304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.858476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:26.860049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.876373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:26.877872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.886883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1156/2292] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:26.900780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:26.902223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:26.950642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d3b7-40d6-4a31-b2f9-c8c858814a0f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:26.954538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:26.955184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.955499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.955775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.956115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:26.975595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.977105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:26.977539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5348-9322-4bac-a7f9-f5b5d072a067 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:26.981268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:26.982041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:26.982420 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:26.982904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:26.987556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1137/2293] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:26.992416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:26.994037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:27.004372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1157/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:27.388026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:27.389595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:27.406540 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa027-d51d-46f8-8dd3-dd02d140f681 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:27.420169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:27.421131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:27.421410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:27.421682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] PATH_INFO: `/v3/projects/25e675ed974a49aface7752a394e57d0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:27.422955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e675ed974a49aface7752a394e57d0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:27.424925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:27.489247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e675ed974a49aface7752a394e57d0', 'request_id': 'req-f394099e-52b5-48ba-afcc-6d51bb73b638'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.497659 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e675ed974a49aface7752a394e57d0', 'request_id': 'req-f394099e-52b5-48ba-afcc-6d51bb73b638'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.504386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e675ed974a49aface7752a394e57d0', 'request_id': 'req-f394099e-52b5-48ba-afcc-6d51bb73b638'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.516372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] The token cache is being invalidate because project 25e675ed974a49aface7752a394e57d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:27.516929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.517351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.519257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1138/2295] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:27 2022] DELETE /identity/v3/projects/25e675ed974a49aface7752a394e57d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:27.523052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:27.523195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:27.524669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:27.524781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:27.539893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325a0e-fbe7-40ec-8b36-feb692eb9f5c service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:27.635343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:27.636774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:27.636774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:27.636969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] PATH_INFO: `/v3/projects/8b973f1d0fdb484f9a2e5f17ec969cb1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:27.638305 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b973f1d0fdb484f9a2e5f17ec969cb1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:27.640328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:27.640864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394099e-52b5-48ba-afcc-6d51bb73b638 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:27.646253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:27.647572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:27.647857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:27.648272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] PATH_INFO: `/v3/users/7a891d33425648f79e601372376e9f17` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:27.649817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a891d33425648f79e601372376e9f17)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:27.652224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:27.733519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:27.764494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b973f1d0fdb484f9a2e5f17ec969cb1', 'request_id': 'req-f040e4c6-9a6f-492d-8736-f88126f1e9d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.775291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b973f1d0fdb484f9a2e5f17ec969cb1', 'request_id': 'req-f040e4c6-9a6f-492d-8736-f88126f1e9d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.779314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a891d33425648f79e601372376e9f17'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.787921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a891d33425648f79e601372376e9f17'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.788368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b973f1d0fdb484f9a2e5f17ec969cb1', 'request_id': 'req-f040e4c6-9a6f-492d-8736-f88126f1e9d6'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.813693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] The token cache is being invalidate because project 8b973f1d0fdb484f9a2e5f17ec969cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:27.814356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a891d33425648f79e601372376e9f17'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.814567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.814999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a891d33425648f79e601372376e9f17'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.815734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.818673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1158/2296] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:27 2022] DELETE /identity/v3/projects/8b973f1d0fdb484f9a2e5f17ec969cb1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:27.822405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:27.829988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:27.831389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a891d33425648f79e601372376e9f17'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:27.845812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1139/2297] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:27 2022] DELETE /identity/v3/users/7a891d33425648f79e601372376e9f17 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:27.946351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040e4c6-9a6f-492d-8736-f88126f1e9d6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:27.978412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:28.048051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:28.050354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:28.071159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:28.072012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.072294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.076378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] PATH_INFO: `/v3/users/15a8bddb7b4441cdbc11900026abd8ae` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.079472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a8bddb7b4441cdbc11900026abd8ae)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:28.086127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:28.143316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e99b-88d3-47be-be5a-d2ab93c25407 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:28.152125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:28.152945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.153356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.153643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.156245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:28.179739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a8bddb7b4441cdbc11900026abd8ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.190914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a8bddb7b4441cdbc11900026abd8ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.191895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a8bddb7b4441cdbc11900026abd8ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.208334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a8bddb7b4441cdbc11900026abd8ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.209551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a8bddb7b4441cdbc11900026abd8ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.235412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:28.237263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:28.239375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1159/2298] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:27 2022] DELETE /identity/v3/users/15a8bddb7b4441cdbc11900026abd8ae => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:28.252272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1140/2299] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:28.615764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:28.617324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:28.728881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:28.731271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:28.753956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909732e-78c5-440c-b225-6c94429f7664 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:28.806614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f8aa-8cee-4008-9e23-185525c61920 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:28.815887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:28.816865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.817151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.817437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] PATH_INFO: `/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.818885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=292f4b2515c54e2aa7b94bb1c86b834d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:28.820950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:28.829959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:28.841374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:28.842673 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.843015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.843377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] PATH_INFO: `/v3/projects/be55749c2bf442c39fb58eca8761ba53` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.846578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be55749c2bf442c39fb58eca8761ba53)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:28.849633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:28.877522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:28.885902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292f4b2515c54e2aa7b94bb1c86b834d', 'request_id': 'req-df1704ae-53b5-4ff4-8290-1f2ab94745cd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.893535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292f4b2515c54e2aa7b94bb1c86b834d', 'request_id': 'req-df1704ae-53b5-4ff4-8290-1f2ab94745cd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.901679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292f4b2515c54e2aa7b94bb1c86b834d', 'request_id': 'req-df1704ae-53b5-4ff4-8290-1f2ab94745cd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.906430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be55749c2bf442c39fb58eca8761ba53', 'request_id': 'req-f51cccba-1f07-42d8-aaf6-52983dced588'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.916369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be55749c2bf442c39fb58eca8761ba53', 'request_id': 'req-f51cccba-1f07-42d8-aaf6-52983dced588'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.919531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] The token cache is being invalidate because project 292f4b2515c54e2aa7b94bb1c86b834d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:28.920129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.921078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-df1704ae-53b5-4ff4-8290-1f2ab94745cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.922397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be55749c2bf442c39fb58eca8761ba53', 'request_id': 'req-f51cccba-1f07-42d8-aaf6-52983dced588'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.924060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1160/2300] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:28 2022] DELETE /identity/v3/projects/292f4b2515c54e2aa7b94bb1c86b834d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:28.930985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bfdd-90f0-4f54-8015-18cdcb9c75a6 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.931646 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bfdd-90f0-4f54-8015-18cdcb9c75a6 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.932644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bfdd-90f0-4f54-8015-18cdcb9c75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.936128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] The token cache is being invalidate because project be55749c2bf442c39fb58eca8761ba53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:28.936465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.937273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-f51cccba-1f07-42d8-aaf6-52983dced588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:28.939045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1141/2301] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:28 2022] DELETE /identity/v3/projects/be55749c2bf442c39fb58eca8761ba53 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:28.945737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3cb4-bc9d-4519-b461-da8359076ead None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:28.946092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3cb4-bc9d-4519-b461-da8359076ead None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:28.946344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3cb4-bc9d-4519-b461-da8359076ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:28.957448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-79b6bfdd-90f0-4f54-8015-18cdcb9c75a6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:28.958831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-79b6bfdd-90f0-4f54-8015-18cdcb9c75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:28.967029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-731b3cb4-bc9d-4519-b461-da8359076ead None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:28.968321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-731b3cb4-bc9d-4519-b461-da8359076ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.061023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1142/2302] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:29.067954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1161/2303] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:29.069747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.070132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.070510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.073573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.073979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.074627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.102742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:29.104381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.116181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1143/2304] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:29.120739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.122211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:29.123671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.133614 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b5195-709d-4b6f-8fa5-bed551bae17c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.140832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1162/2305] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:29.144968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.149895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.150728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.152332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.152691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.153656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:29.155210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.158167 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab9a6c-3f1f-4147-9743-c9fdc6dff51d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.160050 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.174090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.175122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.175459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1144/2306] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:41:29.176607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.176903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.177710 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:29.178020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.179245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.179837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.193282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db01fd-0fdb-4e36-9132-9f764ba57054 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.199380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.200347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1163/2307] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:41:29.200810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.201161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.201441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.202409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.204425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.204805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.217453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447942-830c-47ac-ae81-aabd14223856 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.224592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.225642 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.226998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.228141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.229250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.233045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.245238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1145/2308] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:29.246586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.273627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1164/2309] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:29.277258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.318539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:29.350343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552469-2aa9-4389-926c-83ef0c112c67 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.366639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b44a-4056-42aa-b4bd-1bf7155d5b2e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.373016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.374102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.374510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.374887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.375823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.378830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.412439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1165/2310] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:29.416437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.417546 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.418224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.418503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.418774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.419621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.421569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.433131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269963d-3c4d-4fdc-be7e-6268a69f554b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.442867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.444002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.444297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.444582 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.445472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.447362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.450685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1146/2311] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:29.452551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.463075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1166/2312] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:29.464814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eb3f8-9829-4a3d-82a3-7a91f2ba63cc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.468386 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.484194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.485317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.485596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.485866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.486688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.487458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322404ef-c020-4e0c-8ef3-f4783cb140be admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.488378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.493549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.494404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.494826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.495241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.496170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.498320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.500049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:29.508071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1147/2313] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:41:29.509894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.518043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1167/2314] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:29.522594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.529834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64821e-26bf-4fda-9628-b74a57673be5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.536176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.536868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.537159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.537526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.538256 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.540545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.544112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4955da-939c-4b83-a3cb-3999f596e503 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.556194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.557301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.557673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.558022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] PATH_INFO: `/v3/projects/bc9229668f774c30b18ce3ea22bc9ac1/users/61b8601b0dbe491bb11bb4cb8252f3a7/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.563681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1148/2315] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:29.571482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.578225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9229668f774c30b18ce3ea22bc9ac1, user_id=61b8601b0dbe491bb11bb4cb8252f3a7, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.581075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bac32-0c43-4de1-9982-fefc5b86abfb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.599478 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0818-56c0-4bff-83da-3c5d3729f993 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:29.619914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1168/2316] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:29 2022] PUT /identity/v3/projects/bc9229668f774c30b18ce3ea22bc9ac1/users/61b8601b0dbe491bb11bb4cb8252f3a7/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:29.629594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.630362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.630896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.665058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] MFA Rules not processed for user `61b8601b0dbe491bb11bb4cb8252f3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:29.666290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.770210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:29.771135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.778756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.779136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] PATH_INFO: `/v3/projects/1941203f498349e9a90e80387897c1ba/users/1e74140f47f94999af41a1b6fa2909d4/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.809384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1169/2317] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:29.816833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1941203f498349e9a90e80387897c1ba, user_id=1e74140f47f94999af41a1b6fa2909d4, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:29.820398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c2730-5cb7-4dce-b817-50114e5535a8 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:29.826266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:29.828159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.852962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1149/2318] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:29 2022] PUT /identity/v3/projects/1941203f498349e9a90e80387897c1ba/users/1e74140f47f94999af41a1b6fa2909d4/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:29.868662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:29.868986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:29.869648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:29.945470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] MFA Rules not processed for user `1e74140f47f94999af41a1b6fa2909d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:29.947219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:29.954073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5366-49ef-421f-9533-84160f0339a4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:30.010790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:30.074518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:30.075306 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:30.075531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:30.075781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:30.113070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1150/2319] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:30.129777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:30.131967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:30.191321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:30.240784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:30.242814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:30.258888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71070d3e-eea1-443f-89d2-93296bdfb55c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:30.260092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1170/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:30.266125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:30.267543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:30.267910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:30.268254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:30.280529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:30.282338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42540057-35b4-4170-b771-1f8fd23cdcff service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:30.307098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1151/2321] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:31.262339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:31.263947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:31.385776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a837d-50b1-4235-8680-6a0401f15270 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:31.408282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:31.409272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:31.409616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:31.409955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] PATH_INFO: `/v3/users/a3bd7317600b4d98b40b036669ce9e16` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:31.411844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bd7317600b4d98b40b036669ce9e16)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:31.414815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:31.512805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bd7317600b4d98b40b036669ce9e16'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:31.519872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bd7317600b4d98b40b036669ce9e16'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:31.520818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bd7317600b4d98b40b036669ce9e16'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:31.532468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bd7317600b4d98b40b036669ce9e16'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:31.533641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bd7317600b4d98b40b036669ce9e16'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:31.557295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1171/2322] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:31 2022] DELETE /identity/v3/users/a3bd7317600b4d98b40b036669ce9e16 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:31.559582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7547e7-74cd-4024-becf-37212cda81c9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:31.560370 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7547e7-74cd-4024-becf-37212cda81c9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:31.560654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7547e7-74cd-4024-becf-37212cda81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:31.579056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7f7547e7-74cd-4024-becf-37212cda81c9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:31.580327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7f7547e7-74cd-4024-becf-37212cda81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:31.643091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1152/2323] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:31.660173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:31.661734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:31.751409 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafb1c-9813-4cbf-a961-abebd832c7a3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:31.775558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:31.776367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:31.776773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:31.778277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:31.790554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:31.795480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:31.797277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:31.812574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1172/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:31.919545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:31.919996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:31.920742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:31.965057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] MFA Rules not processed for user `007ce9b8109343e0914efe94c6aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:31.967974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:32.137667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1153/2325] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:32.319505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:32.323259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:32.350209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725e0e-7782-4738-b17c-322e83d53068 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:32.355360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:32.356253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:32.356531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:32.356804 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] PATH_INFO: `/v3/projects/2a38ac8352614a7ea09a3cc364f0dc42` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:32.358299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a38ac8352614a7ea09a3cc364f0dc42)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:32.360234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:32.446655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a38ac8352614a7ea09a3cc364f0dc42', 'request_id': 'req-dee7d51b-8612-41ff-a75e-0bd39189d69e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.455886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a38ac8352614a7ea09a3cc364f0dc42', 'request_id': 'req-dee7d51b-8612-41ff-a75e-0bd39189d69e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.464810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a38ac8352614a7ea09a3cc364f0dc42', 'request_id': 'req-dee7d51b-8612-41ff-a75e-0bd39189d69e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.483173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] The token cache is being invalidate because project 2a38ac8352614a7ea09a3cc364f0dc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:32.483600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.484323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.486021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1173/2326] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:32 2022] DELETE /identity/v3/projects/2a38ac8352614a7ea09a3cc364f0dc42 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:32.490068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:32.502748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b7d5-56fa-4f20-b9fb-1644dd572502 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:32.521671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:32.600112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:32.601130 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:32.601505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:32.601874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] PATH_INFO: `/v3/users/bfc24e5561e040038b1f0a413a18f1d1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:32.603368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc24e5561e040038b1f0a413a18f1d1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:32.605816 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:32.697640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc24e5561e040038b1f0a413a18f1d1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.710724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc24e5561e040038b1f0a413a18f1d1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.732622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc24e5561e040038b1f0a413a18f1d1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.733716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc24e5561e040038b1f0a413a18f1d1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.767437 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc24e5561e040038b1f0a413a18f1d1'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:32.782535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1154/2327] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:32 2022] DELETE /identity/v3/users/bfc24e5561e040038b1f0a413a18f1d1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:33.594454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:33.597084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:33.639103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d51b-8612-41ff-a75e-0bd39189d69e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:33.716023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:33.716976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:33.717260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:33.717534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] PATH_INFO: `/v3/projects/6c3059dc31b847aa9997667456cf0508` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:33.719824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3059dc31b847aa9997667456cf0508)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:33.721824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:33.796450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3059dc31b847aa9997667456cf0508', 'request_id': 'req-87435087-0010-487f-81d1-c9846072e41b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.802635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3059dc31b847aa9997667456cf0508', 'request_id': 'req-87435087-0010-487f-81d1-c9846072e41b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.810770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3059dc31b847aa9997667456cf0508', 'request_id': 'req-87435087-0010-487f-81d1-c9846072e41b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.830336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] The token cache is being invalidate because project 6c3059dc31b847aa9997667456cf0508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:33.830633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.831384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.833209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1174/2328] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:33 2022] DELETE /identity/v3/projects/6c3059dc31b847aa9997667456cf0508 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:33.837996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:33.839714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:33.856604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0beb-9111-4676-ba81-089655a7dd73 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:33.917914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:33.918807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:33.919098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:33.919404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] PATH_INFO: `/v3/users/22cd6e6335f1434eb2e6746d5e59243d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:33.920599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cd6e6335f1434eb2e6746d5e59243d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:33.922592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:33.968362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:33.974445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cd6e6335f1434eb2e6746d5e59243d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.982280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cd6e6335f1434eb2e6746d5e59243d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.989517 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cd6e6335f1434eb2e6746d5e59243d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:33.990322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cd6e6335f1434eb2e6746d5e59243d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.005243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c15c3746-4ec7-49d5-a44f-3067f8f70af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cd6e6335f1434eb2e6746d5e59243d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.012028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1155/2329] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:33 2022] DELETE /identity/v3/users/22cd6e6335f1434eb2e6746d5e59243d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:34.475441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:34.476882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:34.495951 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435087-0010-487f-81d1-c9846072e41b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:34.498093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:34.557040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:34.557959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.558207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.558486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] PATH_INFO: `/v3/projects/5843aecc3cb44442bfe7dc4c57db22de` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.560353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5843aecc3cb44442bfe7dc4c57db22de)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:34.571536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:34.584086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4c66-4c66-4fb7-9bbc-ef465d345ac1 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.584375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4c66-4c66-4fb7-9bbc-ef465d345ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.584654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4c66-4c66-4fb7-9bbc-ef465d345ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.609357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-dd3c4c66-4c66-4fb7-9bbc-ef465d345ac1 None None] MFA Rules not processed for user `ae510389cfc04a0cb4e6991df2a93a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:34.610576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-dd3c4c66-4c66-4fb7-9bbc-ef465d345ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:34.618050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5843aecc3cb44442bfe7dc4c57db22de', 'request_id': 'req-ff0baa8b-5024-48ba-a98e-29f9918f83aa'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.623612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5843aecc3cb44442bfe7dc4c57db22de', 'request_id': 'req-ff0baa8b-5024-48ba-a98e-29f9918f83aa'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.629796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5843aecc3cb44442bfe7dc4c57db22de', 'request_id': 'req-ff0baa8b-5024-48ba-a98e-29f9918f83aa'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.646268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] The token cache is being invalidate because project 5843aecc3cb44442bfe7dc4c57db22de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:34.646554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.647217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ff0baa8b-5024-48ba-a98e-29f9918f83aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:34.648903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1175/2330] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:34 2022] DELETE /identity/v3/projects/5843aecc3cb44442bfe7dc4c57db22de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:34.653648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.653942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.654225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.669870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1156/2331] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:34.671856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:34.673068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:34.736058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1176/2332] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:34.743919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.744204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.744492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.763137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:34.764433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:34.773384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1157/2333] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:34.777806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:34.788209 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887e6e-c6af-4f85-8f5a-84df46230f50 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:34.793073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:34.793730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.794015 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.794284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.795009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:34.795310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:34.796990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:34.812371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1177/2334] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:34.813764 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:34.824077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2d99-2436-4c3c-b435-34163c58f8ca None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:34.828830 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:34.829501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.829772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.830046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.830787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:34.832792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:34.859962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1158/2335] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:34 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:34.864289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:34.876554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdc7cb-d999-420d-bb8d-4912cfda5ba2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:34.899132 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:34.941738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:34.942492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.942774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.943048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.943796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:34.945735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:34.971223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1178/2336] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:34 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:34.972626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:34.983694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de9b4-8ec1-49c7-ac48-4ad813e16cba admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:34.989074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:34.989754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:34.990037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:34.990312 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:34.991065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:34.992800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:35.004759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1159/2337] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:35.009084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:35.020613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7d15-aae1-4bf0-88ec-ff9724497a5e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:35.026219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:35.027000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:35.027374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:35.027719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:35.028520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:35.030241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfb1b0-a91e-4e08-8535-cb6ac8b7de78 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:35.042507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1179/2338] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:35.047044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:35.058854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883558-6ece-49cb-b700-baa3c8f6ae21 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:35.065656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:35.066787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:35.067068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:35.067472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] PATH_INFO: `/v3/projects/3a4400737d154af6bc923bab919505f9/users/69d36794e22946f498c30d6ed0108a9c/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:35.087175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4400737d154af6bc923bab919505f9, user_id=69d36794e22946f498c30d6ed0108a9c, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:35.089952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:35.105061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1160/2339] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:35 2022] PUT /identity/v3/projects/3a4400737d154af6bc923bab919505f9/users/69d36794e22946f498c30d6ed0108a9c/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:35.116930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:35.117224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:35.117504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:35.146934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] MFA Rules not processed for user `69d36794e22946f498c30d6ed0108a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:35.148479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:35.219700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1180/2340] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:35.249411 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:35.251119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:35.311199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816fed4-a51a-40ec-8f72-624869452361 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:35.317745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:35.318596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:35.318993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:35.319270 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:35.330428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:35.331951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf05f8-69d7-4631-9e22-8496a28b02c4 service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:35.341657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1161/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:39.281431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:39.283018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:39.401681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d12f69-7a0b-4efd-8593-bc260fd956b4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:39.413339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:39.414407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:39.414689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:39.415024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] PATH_INFO: `/v3/users/61b8601b0dbe491bb11bb4cb8252f3a7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:39.416467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b8601b0dbe491bb11bb4cb8252f3a7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:39.418484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:39.477895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:39.491382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b8601b0dbe491bb11bb4cb8252f3a7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:39.501219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b8601b0dbe491bb11bb4cb8252f3a7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:39.502190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b8601b0dbe491bb11bb4cb8252f3a7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:39.512903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b8601b0dbe491bb11bb4cb8252f3a7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:39.513666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b8601b0dbe491bb11bb4cb8252f3a7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:39.545080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1181/2342] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:39 2022] DELETE /identity/v3/users/61b8601b0dbe491bb11bb4cb8252f3a7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:39.549219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:39.550367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:39.550806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:39.567660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:39.580811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:39.586356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:39.656503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1162/2343] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:39.666958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:39.668912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:39.746381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68bcf8-f2de-4e8d-b927-cb98e5821c7e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:39.752276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:39.755387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:39.755653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:39.755997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:39.772967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:39.775225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425c21-f3ae-4641-89cb-8bf8fffa599a service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:39.821137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1182/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:41:40.210652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.213885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:40.243903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9ae44-f751-4e95-ad1a-496420df38bf None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.249402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.250654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.251022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.251364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] PATH_INFO: `/v3/projects/bc9229668f774c30b18ce3ea22bc9ac1` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.253059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9229668f774c30b18ce3ea22bc9ac1)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.255197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.347262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9229668f774c30b18ce3ea22bc9ac1', 'request_id': 'req-b018ebb4-64c5-4c43-abf9-7400f7d42add'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:40.357982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9229668f774c30b18ce3ea22bc9ac1', 'request_id': 'req-b018ebb4-64c5-4c43-abf9-7400f7d42add'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:40.364992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9229668f774c30b18ce3ea22bc9ac1', 'request_id': 'req-b018ebb4-64c5-4c43-abf9-7400f7d42add'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:40.377760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] The token cache is being invalidate because project bc9229668f774c30b18ce3ea22bc9ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:40.378046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:40.378698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-b018ebb4-64c5-4c43-abf9-7400f7d42add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:40.383920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1163/2345] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:40 2022] DELETE /identity/v3/projects/bc9229668f774c30b18ce3ea22bc9ac1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:40.385733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.386218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.386312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.409678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:40.411657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:40.495675 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1183/2346] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:40.497999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.498454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.498905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.521897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:40.523186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:40.536061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1164/2347] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:41:40.540530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.551076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256b3fb-5ede-4e89-87d6-91a494488df5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.556323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.557063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.557358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.557645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.558393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:41:40.558717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.560475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.574089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1184/2348] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:41:40.578429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.588940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7f08-c1e7-4f21-bed1-3356df484bac None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.594054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.594822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.595184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.595586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.596408 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.598534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.627190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1165/2349] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:41:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:41:40.631155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.641943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313352-c5db-4ef0-a1d1-f0080f298622 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.684259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:40.702051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.702729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.703009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.703287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.704022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.705923 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.727859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1185/2350] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:41:40 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:41:40.732006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.742946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df850ef1-16e6-4816-92e1-48f9344cfba4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.747886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.748550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.748825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.749092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.749821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.751464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.762840 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1166/2351] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:40.766863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.777024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117276-d187-48ae-a457-198d896ea90e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.781723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.782400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.782687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.782962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.783723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.785460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7760e-928c-483f-bf46-27f48b632798 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.796103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1186/2352] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:41:40.801148 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.816645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3d68-b1b3-4135-994d-5fc742a20d40 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:40.821610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:40.822661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.823047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.824083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] PATH_INFO: `/v3/projects/284de7d4a3c84b82bc8bfea0d9783e4c/users/20aa9136ccea4def95b067b6328ad95d/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.842114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284de7d4a3c84b82bc8bfea0d9783e4c, user_id=20aa9136ccea4def95b067b6328ad95d, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:40.845304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:40.861317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1167/2353] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:41:40 2022] PUT /identity/v3/projects/284de7d4a3c84b82bc8bfea0d9783e4c/users/20aa9136ccea4def95b067b6328ad95d/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:41:40.872962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:40.873247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:40.873524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:40.901126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] MFA Rules not processed for user `20aa9136ccea4def95b067b6328ad95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:40.902338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:40.966928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1187/2354] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:40.982257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:40.984194 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:41.010998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:41.044877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990140e9-3c35-4329-abf9-a89b6805aef2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:41.049051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:41.049705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:41.049986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:41.050259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:41.059111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:41.060604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f171e-a92b-47ce-875d-019ad58b23a9 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:41.069439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1168/2355] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:43.621888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:43.684947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db868-db4a-4f3a-80e2-84c339986564 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:43.689807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:43.690668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:43.690943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:43.691285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] PATH_INFO: `/v3/users/20aa9136ccea4def95b067b6328ad95d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:43.692514 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20aa9136ccea4def95b067b6328ad95d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:43.694443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:43.753884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20aa9136ccea4def95b067b6328ad95d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:43.759288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:43.762316 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20aa9136ccea4def95b067b6328ad95d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:43.763180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20aa9136ccea4def95b067b6328ad95d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:43.774023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20aa9136ccea4def95b067b6328ad95d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:43.774815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20aa9136ccea4def95b067b6328ad95d'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:43.793371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1188/2356] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:41:43 2022] DELETE /identity/v3/users/20aa9136ccea4def95b067b6328ad95d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:43.797832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee25c3-89e4-4029-b131-204774447c89 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:43.798253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee25c3-89e4-4029-b131-204774447c89 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:43.798431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee25c3-89e4-4029-b131-204774447c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:43.815724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-acee25c3-89e4-4029-b131-204774447c89 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:43.817065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-acee25c3-89e4-4029-b131-204774447c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:43.886337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1169/2357] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:43.896111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:43.897616 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:43.966049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365162a-71ad-4e34-aea5-21be5dacabb8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:43.969817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:43.970467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:43.970745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:43.971021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:43.984875 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:43.986495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd1358-8a4c-4375-bdf5-b1107a482b00 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:44.003530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1189/2358] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:44.441826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee25c3-89e4-4029-b131-204774447c89 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:44.443458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-acee25c3-89e4-4029-b131-204774447c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:44.459708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee25c3-89e4-4029-b131-204774447c89 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:44.475966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:44.476928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:44.477111 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:44.477394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] PATH_INFO: `/v3/projects/284de7d4a3c84b82bc8bfea0d9783e4c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:44.478813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] RBAC: Authorizing `identity:delete_project(project_id=284de7d4a3c84b82bc8bfea0d9783e4c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:44.480767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:44.531869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284de7d4a3c84b82bc8bfea0d9783e4c', 'request_id': 'req-263c56a8-77cc-43f7-9606-2176193a170c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:44.540541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284de7d4a3c84b82bc8bfea0d9783e4c', 'request_id': 'req-263c56a8-77cc-43f7-9606-2176193a170c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:44.546772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284de7d4a3c84b82bc8bfea0d9783e4c', 'request_id': 'req-263c56a8-77cc-43f7-9606-2176193a170c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:44.558230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] The token cache is being invalidate because project 284de7d4a3c84b82bc8bfea0d9783e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:41:44.558481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:44.559100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:41:44.560773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1170/2359] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:41:44 2022] DELETE /identity/v3/projects/284de7d4a3c84b82bc8bfea0d9783e4c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:41:53.993920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=36,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:54.086361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52c5-e44f-4f02-8efc-c9db3d7b07fc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:54.086652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52c5-e44f-4f02-8efc-c9db3d7b07fc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:54.086930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52c5-e44f-4f02-8efc-c9db3d7b07fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:54.106238 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-5dbe52c5-e44f-4f02-8efc-c9db3d7b07fc None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:54.107389 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5dbe52c5-e44f-4f02-8efc-c9db3d7b07fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:54.169936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1190/2360] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:54.214012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:54.216187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:54.317314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:54.346271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c56a8-77cc-43f7-9606-2176193a170c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:54.352419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:54.353316 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:54.353747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:54.354179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:54.364187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:54.365801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d188-93e0-4f6b-bd51-a64db76544e9 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:54.375397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1171/2361] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:41:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 13:42:04.160753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=25 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:04.372036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:10.231246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.231845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.231997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.233463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1191/2362] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:42:10.239719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565610e-328a-4387-a637-b3f65c40082b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.240182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565610e-328a-4387-a637-b3f65c40082b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.240275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565610e-328a-4387-a637-b3f65c40082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.290630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7565610e-328a-4387-a637-b3f65c40082b None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:10.291888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7565610e-328a-4387-a637-b3f65c40082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.416528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1172/2363] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:10.428257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.430225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.495111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499061ba-daa6-41fd-943c-adf615dce3c7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.498848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.499659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.499945 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.500222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.511542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.513017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50590154-6b3c-40c2-b5b4-1f21317704d3 service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.523992 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1192/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:10.596132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.596509 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.596795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] PATH_INFO: `/` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.598210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1173/2365] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:42:10.603005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a21ef-5f46-4d58-a05d-ce191fedb887 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.603295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a21ef-5f46-4d58-a05d-ce191fedb887 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.603608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a21ef-5f46-4d58-a05d-ce191fedb887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.633773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-ce5a21ef-5f46-4d58-a05d-ce191fedb887 None None] MFA Rules not processed for user `ffb912f209ff452583ce16ca36ae1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:10.635017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ce5a21ef-5f46-4d58-a05d-ce191fedb887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.702234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1193/2366] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:10.717520 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.719611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.734620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12479536-6cfc-4817-9a19-f7b9439d395e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.738656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.739285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.739596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.739867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.747136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.748608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d54477-96c1-4eba-bb1c-553fec0e3526 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.756500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1174/2367] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:10.841965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42a07-8683-4e67-bc04-721ee8fc763b None None] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.842256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42a07-8683-4e67-bc04-721ee8fc763b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.842532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42a07-8683-4e67-bc04-721ee8fc763b None None] PATH_INFO: `/` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.843979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1194/2368] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 23 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:42:10.849342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05536-0c6c-410a-b2fd-24347ecf8464 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.849632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05536-0c6c-410a-b2fd-24347ecf8464 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.849903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05536-0c6c-410a-b2fd-24347ecf8464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.870212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-32f05536-0c6c-410a-b2fd-24347ecf8464 None None] MFA Rules not processed for user `db1031b48c8142508bd94fe89142a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:10.871457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-32f05536-0c6c-410a-b2fd-24347ecf8464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.882022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1175/2369] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 23 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:10.892892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d42a07-8683-4e67-bc04-721ee8fc763b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.904656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d42a07-8683-4e67-bc04-721ee8fc763b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.909112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.909759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.910040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.910339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.921030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.922485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.934741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1195/2370] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:13.396888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:13.397390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:13.397486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:13.416056 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:13.417254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:13.425063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1176/2371] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:13.440149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:13.456894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf5b69-8049-4c82-a335-f1cf074fcb9d service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:13.463592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:13.464242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:13.464522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:13.464792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:13.473950 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:13.475744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a2a9-125e-4d1c-8903-abbd7bb24d9b service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:13.484166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1196/2372] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:42:16.162823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.164390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:16.331128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:16.377562 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f932-4f24-40a4-87b4-be1c2cd1e553 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.383791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.385272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.385825 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.386461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] PATH_INFO: `/v3/users/1e74140f47f94999af41a1b6fa2909d4` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.388637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e74140f47f94999af41a1b6fa2909d4)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.391450 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.503045 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e74140f47f94999af41a1b6fa2909d4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:16.511539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e74140f47f94999af41a1b6fa2909d4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:16.520132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e74140f47f94999af41a1b6fa2909d4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:16.520741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e74140f47f94999af41a1b6fa2909d4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:16.535585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e74140f47f94999af41a1b6fa2909d4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:16.544928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1177/2373] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:16 2022] DELETE /identity/v3/users/1e74140f47f94999af41a1b6fa2909d4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:16.547063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.547608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.547798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.577139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:16.578453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:16.639218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:16.654073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1197/2374] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:42:16.662031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.664443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:16.737973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2bae-775d-4ea7-ad07-0caedde06dc9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.743165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.743849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.744131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.744402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.756075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.757600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49947037-7872-4c09-b263-2c94ac5fc04d service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.772843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1178/2375] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:17.085121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.086725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.105560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488eec3-970d-4525-abcf-1f053d9de661 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.112939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.114263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.114580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.114834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] PATH_INFO: `/v3/projects/1941203f498349e9a90e80387897c1ba` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.116632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1941203f498349e9a90e80387897c1ba)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.125122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.179149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1941203f498349e9a90e80387897c1ba', 'request_id': 'req-373bdc58-801a-417e-a6ed-2d2c53293fe9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:17.186831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1941203f498349e9a90e80387897c1ba', 'request_id': 'req-373bdc58-801a-417e-a6ed-2d2c53293fe9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:17.194033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1941203f498349e9a90e80387897c1ba', 'request_id': 'req-373bdc58-801a-417e-a6ed-2d2c53293fe9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:17.208806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] The token cache is being invalidate because project 1941203f498349e9a90e80387897c1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:17.209899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:17.210873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-373bdc58-801a-417e-a6ed-2d2c53293fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:17.212880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1198/2376] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:17 2022] DELETE /identity/v3/projects/1941203f498349e9a90e80387897c1ba => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:17.218404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.219106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.219771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.259046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:17.260320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.296220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:17.325644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1179/2377] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:42:17.334171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.334778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.335064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.374542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:17.375817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.384870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1199/2378] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:17.389167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.398734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd8a6-0d92-4e7b-9e75-0e1d383c77c6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.406836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856eef-c786-424f-a837-882b70889472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.407740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856eef-c786-424f-a837-882b70889472 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.408035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856eef-c786-424f-a837-882b70889472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.408304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856eef-c786-424f-a837-882b70889472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.409865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856eef-c786-424f-a837-882b70889472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:42:17.410181 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856eef-c786-424f-a837-882b70889472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.411901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856eef-c786-424f-a837-882b70889472 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.432095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1180/2379] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:42:17.436613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.450174 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cd4d1-1cf2-4352-bec6-7c4a9cf93b18 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.455807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.456523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.456812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.457089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.458034 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.460558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.487373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1200/2380] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:17.491541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856eef-c786-424f-a837-882b70889472 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.504037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856eef-c786-424f-a837-882b70889472 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.596537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.597234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.597521 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.597797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.598721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.601053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.622966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1181/2381] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:17.627509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.637891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341c05f-4f0f-44e8-84ef-f88284d53b11 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.642759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.643660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.643985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.644295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.645191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.646895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.659376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1201/2382] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:17.662997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.689048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a3ba6-d5ff-4a5a-8588-9d394db1d746 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.697046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.697733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.698019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.698453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.699633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.701447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08e91-0b95-401f-af54-9240c0e5d466 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.713263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1182/2383] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:42:17.717473 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.727564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1381-69e8-455c-bb96-fc19c6e8e7d0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.732217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.733108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.733391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.733668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] PATH_INFO: `/v3/projects/28b455b8dd8b4910803ac509413a97e6/users/157d5f6570024c468db34ae0ca7ad622/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.749036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b455b8dd8b4910803ac509413a97e6, user_id=157d5f6570024c468db34ae0ca7ad622, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.751895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.766117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1202/2384] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:17 2022] PUT /identity/v3/projects/28b455b8dd8b4910803ac509413a97e6/users/157d5f6570024c468db34ae0ca7ad622/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:17.771846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641711-b92e-4352-9909-ab2a1f991256 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.772220 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641711-b92e-4352-9909-ab2a1f991256 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.772624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641711-b92e-4352-9909-ab2a1f991256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.791685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2a641711-b92e-4352-9909-ab2a1f991256 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:17.793166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2a641711-b92e-4352-9909-ab2a1f991256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.855660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1183/2385] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:17.865619 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.867780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.927631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2913e0-0560-45c1-bcb0-c29f7e49c116 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.931325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.932024 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.932451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.932822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.943989 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.945332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.955020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1203/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:22.971279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:22.971826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:22.971928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.017447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] MFA Rules not processed for user `157d5f6570024c468db34ae0ca7ad622`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:23.017447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:23.090162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:23.136841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1184/2387] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:42:23.141379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.151692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded75a-5443-4e30-90f2-55f7034c70c3 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.157080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.157761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.158041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.158317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.159165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.161433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.188503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:23.199187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1204/2388] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:23 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:23.202567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.218496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8de0d-dfbe-4740-8c39-b8210dc2b2ef None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.293611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.294305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.294592 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.294867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.296112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.298211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.330666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1185/2389] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:23 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:23.331801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.346833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf768-da59-4f53-aed7-98a3e8ee2c8c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.370205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.370916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.371204 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.371510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.372263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.373898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.418629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1205/2390] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:23.419324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.433354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55449b-8525-4a7b-8229-bd66aba098e9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.440537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.441809 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.442165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.442515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] PATH_INFO: `/v3/projects/f26c3baf01204f74b713049cb489ee26/users/bbb09786cd2640e6955e449c25a0b7a3/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.460926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26c3baf01204f74b713049cb489ee26, user_id=bbb09786cd2640e6955e449c25a0b7a3, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.464138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.512161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1186/2391] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:23 2022] PUT /identity/v3/projects/f26c3baf01204f74b713049cb489ee26/users/bbb09786cd2640e6955e449c25a0b7a3/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:23.516170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.527728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaac25c-c1fe-4d1b-bf82-153652d6c3f2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.632078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.633103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.633518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.633852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.634797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.636708 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.648560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1206/2392] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:23.652992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:23.665159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022e272-8d7b-478c-9153-1187bee92f75 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:23.670573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:23.671647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:23.671941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:23.672210 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] PATH_INFO: `/v3/projects/f26c3baf01204f74b713049cb489ee26/users/bbb09786cd2640e6955e449c25a0b7a3/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:23.674299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26c3baf01204f74b713049cb489ee26, user_id=bbb09786cd2640e6955e449c25a0b7a3, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:23.677132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:23.691570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1187/2393] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:23 2022] PUT /identity/v3/projects/f26c3baf01204f74b713049cb489ee26/users/bbb09786cd2640e6955e449c25a0b7a3/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:25.804787 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:25.806780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:25.957782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978fc67-c0d6-4cd0-ab31-92bfafa54a48 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:26.032467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:26.033606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:26.033986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:26.034393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:26.037739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:26.052334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:26.054364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87be3aa-07bb-434b-a2fb-25cb06a519f1 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:26.059987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:26.073762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1207/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:26.919163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:26.921619 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:27.021750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab3db-b80d-4502-b20a-70fcfe4c1434 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:27.031590 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:27.032503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:27.032784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:27.033059 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] PATH_INFO: `/v3/users/69d36794e22946f498c30d6ed0108a9c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:27.036329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d36794e22946f498c30d6ed0108a9c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:27.038275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:27.096129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:27.157382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d36794e22946f498c30d6ed0108a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:27.172333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d36794e22946f498c30d6ed0108a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:27.188832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d36794e22946f498c30d6ed0108a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:27.189479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d36794e22946f498c30d6ed0108a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:27.212213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d36794e22946f498c30d6ed0108a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:27.222351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1188/2395] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:26 2022] DELETE /identity/v3/users/69d36794e22946f498c30d6ed0108a9c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:27.224986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:27.225478 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:27.225580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:27.265844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:27.267107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:27.437924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1208/2396] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:27.464476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:27.468015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:27.573817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd016b-96d3-4520-9f67-ce240c297bde admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:27.578306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:27.579189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:27.579505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:27.579932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:27.592862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:27.594631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade481c-b630-4b5f-b944-a709583db93f service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:27.608363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1189/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:28.288895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.292851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:28.309489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fda5a-8c11-4edf-ad8a-edcc019d9016 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.317586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.318999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.319540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.320018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] PATH_INFO: `/v3/projects/3a4400737d154af6bc923bab919505f9` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.321995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4400737d154af6bc923bab919505f9)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.329220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.406680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4400737d154af6bc923bab919505f9', 'request_id': 'req-e444eb38-10cb-4a12-94f4-07582e809107'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:28.414443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4400737d154af6bc923bab919505f9', 'request_id': 'req-e444eb38-10cb-4a12-94f4-07582e809107'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:28.422498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4400737d154af6bc923bab919505f9', 'request_id': 'req-e444eb38-10cb-4a12-94f4-07582e809107'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:28.443222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] The token cache is being invalidate because project 3a4400737d154af6bc923bab919505f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:28.443792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:28.444656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e444eb38-10cb-4a12-94f4-07582e809107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:28.450756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1209/2398] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:28 2022] DELETE /identity/v3/projects/3a4400737d154af6bc923bab919505f9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:28.452436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.452893 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.453356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.484945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:28.487523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:28.591878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.592192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.593495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.597223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1190/2399] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:28.617629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:28.619560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:28.629192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1210/2400] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:28.634554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.645322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b23820-83cb-4176-a056-cb149419a15d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.649984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.650723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.651091 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.651598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.652389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:42:28.652761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.654481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.672630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.673378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1191/2401] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:42:28.682503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0754-7b48-4bd1-91ed-560548ea3b0f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.687692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.689404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.689404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.689404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.691102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.694008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.732037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1211/2402] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:28 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:28.736083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.747761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd105bda-30c2-4fa6-99b3-0851768e1777 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.802159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:28.841209 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.841864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.842159 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.842431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.843416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.846330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.873222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1192/2403] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:28 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:28.877400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.894550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b040-749e-4aea-becd-38168e7d40db admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.906564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.907242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.907579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.907850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.908608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.910880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.926290 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:28.927226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1212/2404] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:28.941801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72c77-3b1f-414e-9a8e-82a67c42c179 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:28.948375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:28.956157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:28.957768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:28.957768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:28.957768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:28.960124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22760b0-7835-4ee4-a8e1-24b012d677b0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:28.974934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1193/2405] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:28.980470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:29.001596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b978d-0394-4879-9649-9abac695dde1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:29.007741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:29.008822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.009250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.009690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] PATH_INFO: `/v3/projects/0d6c438e59834c4084c818053e1fdb93/users/0a9f85caf65f431c96f27a7d04734211/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.031597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6c438e59834c4084c818053e1fdb93, user_id=0a9f85caf65f431c96f27a7d04734211, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:29.035521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:29.059367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1213/2406] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:28 2022] PUT /identity/v3/projects/0d6c438e59834c4084c818053e1fdb93/users/0a9f85caf65f431c96f27a7d04734211/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:29.064263 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58786-7e06-469a-9345-5912405d8073 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.064648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58786-7e06-469a-9345-5912405d8073 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.064934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58786-7e06-469a-9345-5912405d8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.090248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b9e58786-7e06-469a-9345-5912405d8073 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:29.091707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b9e58786-7e06-469a-9345-5912405d8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.193452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1194/2407] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:29.199109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:29.200916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.229031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:29.285895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89821-bba1-49e3-bb31-7403bdafe1f4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:29.292454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:29.293196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.293807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.293947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.304873 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:29.306317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:29.320014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1214/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:29.437530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cde10-6dc4-43b1-aa3f-35b5c7d16dbb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.437922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cde10-6dc4-43b1-aa3f-35b5c7d16dbb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.439083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cde10-6dc4-43b1-aa3f-35b5c7d16dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.474219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7d5cde10-6dc4-43b1-aa3f-35b5c7d16dbb None None] MFA Rules not processed for user `bbb09786cd2640e6955e449c25a0b7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:29.475770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7d5cde10-6dc4-43b1-aa3f-35b5c7d16dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.575228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1195/2409] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:29.588370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:29.589833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.662604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9f425-7003-4130-bb16-064651cab76f service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:29.666246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:29.666898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.667176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.667479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.669283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.757053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:29.759509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:29.774819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1215/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:29.921219 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40d76-7e4c-4cea-a1cb-679ff919c662 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:29.921738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40d76-7e4c-4cea-a1cb-679ff919c662 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:29.922094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40d76-7e4c-4cea-a1cb-679ff919c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:29.949804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3ac40d76-7e4c-4cea-a1cb-679ff919c662 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:29.954835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ac40d76-7e4c-4cea-a1cb-679ff919c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:29.996874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:30.049992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1196/2411] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:30.063123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:30.064891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:30.167195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be881fed-e01e-48f5-b9ba-62725d163bdf service glance] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:30.174991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:30.175868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:30.176154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:30.176427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:30.186393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:30.188446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:30.200846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1216/2412] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:42:35.646401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:35.647140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:35.647140 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:35.693784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] MFA Rules not processed for user `0a9f85caf65f431c96f27a7d04734211`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:35.695202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:35.809002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1197/2413] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:35.813712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:35.822919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:35.838901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ce61-c7a1-42dc-9dc1-1c0271b2f289 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:35.844212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:35.844757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:35.845035 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:35.845360 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:35.846727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:35.849018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:35.909413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1217/2414] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:35 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:35.913668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:35.933575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5e83f-83e1-4891-a62f-73c1f34ab3a6 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:36.057758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:36.058696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:36.059264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:36.059693 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:36.060510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:36.062618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:36.101516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1198/2415] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:35 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:36.107555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:36.125772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b178a9-385c-4147-97b0-071212c266e0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:36.144921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:36.147433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:36.148350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:36.148937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:36.150572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:36.154833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:36.178278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1218/2416] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:36.182307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:36.195021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82695-c4a6-49ab-9afc-6cc6a7ec3fb9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:36.201554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:36.202532 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:36.202884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:36.204268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] PATH_INFO: `/v3/projects/2b79d3fc84d14047869621c77ca0c2bb/users/1896bdbe02374c2583aff5b5cd4cad3a/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:36.229068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b79d3fc84d14047869621c77ca0c2bb, user_id=1896bdbe02374c2583aff5b5cd4cad3a, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:36.232223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:36.262403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1199/2417] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:36 2022] PUT /identity/v3/projects/2b79d3fc84d14047869621c77ca0c2bb/users/1896bdbe02374c2583aff5b5cd4cad3a/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:36.266558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:36.280391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207d0e-4923-4faa-a7e2-7e6777414584 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:36.457603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:36.460388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:36.460928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:36.461388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:36.462749 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:36.464935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e621b3-bbf5-470f-9362-f502607df161 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:36.482017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1219/2418] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:36.484579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:36.500757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc93a9-6fc7-425f-bc53-80f636f9f38d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:36.507257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:36.508600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:36.509108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:36.509602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] PATH_INFO: `/v3/projects/2b79d3fc84d14047869621c77ca0c2bb/users/1896bdbe02374c2583aff5b5cd4cad3a/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:36.512541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b79d3fc84d14047869621c77ca0c2bb, user_id=1896bdbe02374c2583aff5b5cd4cad3a, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:36.516138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:36.529175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1200/2419] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:36 2022] PUT /identity/v3/projects/2b79d3fc84d14047869621c77ca0c2bb/users/1896bdbe02374c2583aff5b5cd4cad3a/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:43.616939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042667-caef-4882-8488-3fd33674aa60 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:43.617999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042667-caef-4882-8488-3fd33674aa60 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:43.618496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042667-caef-4882-8488-3fd33674aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:43.680432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-05042667-caef-4882-8488-3fd33674aa60 None None] MFA Rules not processed for user `1896bdbe02374c2583aff5b5cd4cad3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:43.681881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-05042667-caef-4882-8488-3fd33674aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:43.804636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1220/2420] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:43.818353 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:43.820033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:43.858217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:43.963977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d445a-8f5e-45b2-bfd4-bd06d2ac3fe6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:43.970308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:43.971063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:43.971439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:43.971777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:44.036047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:44.036047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791077a-6d58-4ff6-84c2-78a389168401 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:44.053634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1201/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:42:46.038039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:46.038638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:46.038638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:46.059058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] MFA Rules not processed for user `157d5f6570024c468db34ae0ca7ad622`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:46.060633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:46.117643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:46.127969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1221/2422] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:52.166348 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310262-af61-493f-8c5a-daafc8e7f64c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:52.166898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310262-af61-493f-8c5a-daafc8e7f64c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:52.166898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310262-af61-493f-8c5a-daafc8e7f64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:52.224403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e5310262-af61-493f-8c5a-daafc8e7f64c None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:52.225821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e5310262-af61-493f-8c5a-daafc8e7f64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:52.303608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1202/2423] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:52.319592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:52.418355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f917ce-2894-4d47-a64a-19b8c385d5f3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:52.423612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:52.424260 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:52.424614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:52.424858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:52.434226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:52.435886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:52.445484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1222/2424] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:42:53.188294 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ee1d-8471-4429-817e-6769f4d9d6dc None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:53.188801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ee1d-8471-4429-817e-6769f4d9d6dc None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:53.188895 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ee1d-8471-4429-817e-6769f4d9d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:53.216901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2a78ee1d-8471-4429-817e-6769f4d9d6dc None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:53.218138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2a78ee1d-8471-4429-817e-6769f4d9d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:53.225604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1203/2425] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:53.243954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:53.254669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfceb-5234-42bf-ba7b-49fb66325744 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:53.261626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:53.262287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:53.262566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:53.262840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:53.271909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:53.273649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23781e9-555d-4ee0-afcd-a6f8d906a9df service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:53.284090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1223/2426] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:43:03.203189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:03.251989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:03.252283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:03.252561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:03.271106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] MFA Rules not processed for user `0a9f85caf65f431c96f27a7d04734211`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:43:03.272401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:43:03.279911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=43 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:03.280810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1204/2427] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:43:13.265434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:21.838998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be388a-a7ce-40e9-af51-75b26ce26c80 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:21.839566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be388a-a7ce-40e9-af51-75b26ce26c80 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:21.839566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be388a-a7ce-40e9-af51-75b26ce26c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:21.858524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a0be388a-a7ce-40e9-af51-75b26ce26c80 None None] MFA Rules not processed for user `7fd8fce7c040433e908a4fe6c6b13e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:43:21.859782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a0be388a-a7ce-40e9-af51-75b26ce26c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:43:21.921199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1224/2428] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:43:27.949523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:43:27.951198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:43:28.009976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde45f-cca8-472d-a128-cc383fb51145 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:43:28.014165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:43:28.014964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:28.015240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:28.015572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:28.025735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:43:28.027201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:43:28.036863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1205/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:43:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:43:28.128561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1058c1-c12c-4076-88c3-33540ddeae80 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:28.129068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1058c1-c12c-4076-88c3-33540ddeae80 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:28.129230 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1058c1-c12c-4076-88c3-33540ddeae80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:28.149153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6b1058c1-c12c-4076-88c3-33540ddeae80 None None] MFA Rules not processed for user `007ce9b8109343e0914efe94c6aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:43:28.150408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6b1058c1-c12c-4076-88c3-33540ddeae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:43:28.215848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1225/2430] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:43:29.149418 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:43:29.160902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61ad6-74da-4b5d-8fb6-f78e6ff43ab7 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:43:29.165041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:43:29.165888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:29.166173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:29.166434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:29.232388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:43:29.234663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dd9c1-7839-4234-aabc-eede61b78320 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:43:29.247732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1206/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:43:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:43:38.207504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=50 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:39.242254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=56 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:42.150226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:43:42.150772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:43:42.150772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:43:42.168555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] MFA Rules not processed for user `ae510389cfc04a0cb4e6991df2a93a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:43:42.169738 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:43:42.228959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1226/2432] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:43:52.219016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=25 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:03.813730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:03.814244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:03.814431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:03.835969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] MFA Rules not processed for user `b191f41e53064acbaf17e3da073e7c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:03.837166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:03.894097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1207/2433] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:44:13.886897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=25 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:14.926074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:14.936109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0b7f-9c32-4da2-8211-76fa813b5ffb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:14.940151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:14.940800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:14.941083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:14.941359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:14.943301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:14.957380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:14.959127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:14.970325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1227/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:15.662115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:15.672942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcbbb-b542-42f7-a289-d80ae381afef None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:15.677249 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:15.677953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:15.678276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:15.678646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:15.680726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:15.696841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:15.698744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:15.712853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1208/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:24.965273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=6 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:25.532519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:25.534283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:25.610867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf875-2027-4165-8f40-415899608ff9 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:25.615554 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:25.616579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:25.617053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:25.617395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] PATH_INFO: `/v3/users/7fd8fce7c040433e908a4fe6c6b13e08` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:25.618659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd8fce7c040433e908a4fe6c6b13e08)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:25.621395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:25.689867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd8fce7c040433e908a4fe6c6b13e08'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:25.696942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd8fce7c040433e908a4fe6c6b13e08'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:25.697672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd8fce7c040433e908a4fe6c6b13e08'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:25.706587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd8fce7c040433e908a4fe6c6b13e08'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:25.706818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:25.709362 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd8fce7c040433e908a4fe6c6b13e08'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:25.735288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1228/2436] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:44:25 2022] DELETE /identity/v3/users/7fd8fce7c040433e908a4fe6c6b13e08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:44:25.912533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:25.923956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4efa1-e165-4fca-8154-9840f9e39b50 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:25.986536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:25.987326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:25.987640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:25.987904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] PATH_INFO: `/v3/projects/5ed01b7f521c413e944560db54281ebc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:25.989085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed01b7f521c413e944560db54281ebc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:25.990976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:26.038180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed01b7f521c413e944560db54281ebc', 'request_id': 'req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:26.046598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed01b7f521c413e944560db54281ebc', 'request_id': 'req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:26.052061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed01b7f521c413e944560db54281ebc', 'request_id': 'req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:26.062648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] The token cache is being invalidate because project 5ed01b7f521c413e944560db54281ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:44:26.063085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:26.063651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:44:26.065134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1209/2437] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:44:25 2022] DELETE /identity/v3/projects/5ed01b7f521c413e944560db54281ebc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:44:34.311661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:34.313944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:34.393150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea6530-116b-4906-aefb-bcb46c5f4651 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:34.405703 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:34.460781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:34.461438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:34.461750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:34.462028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:34.463982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:34.523252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:34.524905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:34.533975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1229/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:34.540553 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:34.542166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:34.604441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84518-68c4-4ddf-93bc-d8e28fb472cf admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:34.608269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:34.608919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:34.609200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:34.609479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:34.611427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:34.621293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:34.622787 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:34.631876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1210/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:34.948790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:34.950392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:35.024304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed81b-fd05-4af0-909b-d3da7f1e6e48 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:35.032594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:35.033253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:35.033529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:35.033798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:35.036152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:35.049725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:35.052343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:35.065760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1230/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:44.059854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:44.061433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.072483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c51e9e-787f-4895-9019-cf4ee64e0d7c service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:44.076872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:44.077502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:44.077783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:44.078053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:44.079898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.090545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:44.092047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:44.100925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1211/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:44.117968 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:44.119566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.168220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:44.200292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290014b-7ee6-475f-9587-aa0b0e92cc15 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:44.204404 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:44.205056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:44.205335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:44.205604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:44.207941 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.270092 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:44.271563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceeb86-7405-4160-8084-b26448a9e8e0 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:44.280946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1231/2442] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:53.258099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:53.260748 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:53.286779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087782-ed94-4581-8ee7-295c0952f8ce service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:53.297543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:53.299750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:53.301650 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:53.302207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:53.309805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:53.329692 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:53.334927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:53.349736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1212/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:54.276639 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=37 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:57.529902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:57.530540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:57.530540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:57.548355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] MFA Rules not processed for user `007ce9b8109343e0914efe94c6aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:57.549544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:57.556644 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1232/2444] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:57.863989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:57.869069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:57.877260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ed9b-a1bb-4bfe-9f86-1d898dc3d438 service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:57.882710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:57.883397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:57.883697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:57.883984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:57.886302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:57.897138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:57.898611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:57.907075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1213/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:06.510055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:06.520226 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d32ef-9049-4838-ac57-29edfb84a5a5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:06.524158 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:06.524792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:06.525070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:06.525338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:06.527307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:06.592022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:06.593561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:06.603737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1233/2446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:07.490135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:07.504207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3913-2a1f-42c2-9896-c8146f783048 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:07.512180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:07.513193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:07.513698 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:07.514193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:07.517519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:07.603499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:07.605747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:07.616345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1214/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:09.060527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:09.062202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:09.081671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f742a5-fdb7-4a7b-ad18-5eb56af56c6a service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:09.090353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:09.091240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:09.091649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:09.091930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:09.094359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:09.113189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:09.114808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:09.127783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1234/2448] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:09.778690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:09.790550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce89063-f3cc-4335-8a50-0a4843b4d12a service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:09.799264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:09.800279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:09.800568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:09.800846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:09.802710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:09.815094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:09.817006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:09.834858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1215/2449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:09.853605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:09.855183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:09.890695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7455-7c51-4069-881a-26b66d73b728 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:09.899998 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:09.901434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:09.901718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:09.901982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] PATH_INFO: `/v3/users/ae510389cfc04a0cb4e6991df2a93a00` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:09.903405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae510389cfc04a0cb4e6991df2a93a00)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:09.905502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:09.986559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae510389cfc04a0cb4e6991df2a93a00'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:09.993333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae510389cfc04a0cb4e6991df2a93a00'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:09.993999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae510389cfc04a0cb4e6991df2a93a00'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.001683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae510389cfc04a0cb4e6991df2a93a00'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.002465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-022c0f09-36cf-4464-a49f-675e4ca70d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae510389cfc04a0cb4e6991df2a93a00'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.026121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1235/2450] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:09 2022] DELETE /identity/v3/users/ae510389cfc04a0cb4e6991df2a93a00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:10.204066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.215531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573baa8-c9ae-47fe-bbc7-fba26848cee7 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.272634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.273516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.273798 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.274077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] PATH_INFO: `/v3/projects/855cb6e79485414ab0f2a40162231d72` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.275274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855cb6e79485414ab0f2a40162231d72)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.277275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.325351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855cb6e79485414ab0f2a40162231d72', 'request_id': 'req-58c2f09f-4c59-4243-9656-1ff8be19a782'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.334089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855cb6e79485414ab0f2a40162231d72', 'request_id': 'req-58c2f09f-4c59-4243-9656-1ff8be19a782'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.339820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855cb6e79485414ab0f2a40162231d72', 'request_id': 'req-58c2f09f-4c59-4243-9656-1ff8be19a782'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.350731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] The token cache is being invalidate because project 855cb6e79485414ab0f2a40162231d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:10.351018 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.351658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-58c2f09f-4c59-4243-9656-1ff8be19a782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:10.353225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1216/2451] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:10 2022] DELETE /identity/v3/projects/855cb6e79485414ab0f2a40162231d72 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:10.358296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.358695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.358854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.377100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:10.378169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:10.422889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:10.445066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1236/2452] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:45:10.452997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.453380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.453716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.462248 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:10.475177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:10.476518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:10.485068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1217/2453] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:10.489434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.499784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7ace-cb06-46e7-af1e-6c181c382b54 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.504597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.505284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.505569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.505854 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.506756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:10.507070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.508839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.524403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1237/2454] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:10.531367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.540906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7978-b5e7-4e4a-aef8-46e499b38375 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.545632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.546499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.546847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.547188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.547938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.549861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.578888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1218/2455] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:10.580428 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.590767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c0d0-783c-46d2-a1b1-d59c4cca5c73 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.646268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.646928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.647207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.647517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.648200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.650128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.673077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1238/2456] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:10.677255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.687823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e6fd5-0618-4cde-80e1-7ba7fe5711b1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.692466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.693147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.693424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.693694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.694462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.696122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.706482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1219/2457] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:10.710770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.720903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1535b-62a2-4641-99c7-387d99b0774a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.725850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.726498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.726773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.727069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.727828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.729439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a617-ae2b-4f81-ba68-48b61f6c4625 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.739451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1239/2458] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:45:10.743623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.754224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a672-2b0d-472d-bce3-f3f6079516f9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.759700 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.760601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.760963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.761193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] PATH_INFO: `/v3/projects/a257d1a49cfe48afb5b3b3fc87e23f6e/users/2fbcc3bc0eec458fb4936a1cba504154/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.779170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a257d1a49cfe48afb5b3b3fc87e23f6e, user_id=2fbcc3bc0eec458fb4936a1cba504154, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.783374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:10.797494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1220/2459] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:10 2022] PUT /identity/v3/projects/a257d1a49cfe48afb5b3b3fc87e23f6e/users/2fbcc3bc0eec458fb4936a1cba504154/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:10.807944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.808233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.808507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.834927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] MFA Rules not processed for user `2fbcc3bc0eec458fb4936a1cba504154`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:10.836159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:10.910142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1240/2460] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:10.915004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:10.985092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62747522-dc16-43d9-bcb7-14545dd098fe admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:10.990938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:10.991651 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:10.991935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:10.992203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:10.992885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:10.994811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.022172 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1221/2461] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:11.026449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.037597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2a3b-1d12-443f-a40c-ea6b7a039c95 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.082852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:11.106051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.106767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.107049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.107345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.108056 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.110272 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.130883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1241/2462] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:11 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:11.135037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.145646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0ad4-1a5e-41e1-90ab-f5692939e4f7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.150202 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.150865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.151146 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.151460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.152190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.153930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.164932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1222/2463] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:11.169048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.179494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57503f91-c998-48c3-bb77-2453eda8802f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.184319 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.185363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.185653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.186030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] PATH_INFO: `/v3/projects/65f76d3d9ce34d15b713e5313618558c/users/a900fc017c844213a552ef758f02b04f/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.202457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f76d3d9ce34d15b713e5313618558c, user_id=a900fc017c844213a552ef758f02b04f, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.205197 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.219763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1242/2464] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:11 2022] PUT /identity/v3/projects/65f76d3d9ce34d15b713e5313618558c/users/a900fc017c844213a552ef758f02b04f/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:11.223730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.237912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c30-fc00-4ae6-bdf7-351f25019ed2 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.298727 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.299621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.299998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.300375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.301413 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.303128 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c15c1-46d0-4a61-8026-9a7905254fb9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.314569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1223/2465] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:45:11.318653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.329512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc669c7-e33f-47c2-a192-fcc25b3a9bf1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.334577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.335519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.335798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.336084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] PATH_INFO: `/v3/projects/65f76d3d9ce34d15b713e5313618558c/users/a900fc017c844213a552ef758f02b04f/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.338057 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f76d3d9ce34d15b713e5313618558c, user_id=a900fc017c844213a552ef758f02b04f, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.340743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.352085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1243/2466] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:11 2022] PUT /identity/v3/projects/65f76d3d9ce34d15b713e5313618558c/users/a900fc017c844213a552ef758f02b04f/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:11.363226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.363658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.363941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.385057 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:11.393157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] MFA Rules not processed for user `a900fc017c844213a552ef758f02b04f`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:11.395000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:11.468191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1224/2467] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:11.479711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:11.481636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:11.548382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aa899-4669-4066-b0a9-91eebd000a11 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:11.552441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:11.553081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:11.553363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:11.553635 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:11.563003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:11.564487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70515-d762-4d80-b5d9-9bb0d9680b94 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:11.574652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1244/2468] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:11.995254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:12.062654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aed3d-e54c-4b2e-a29c-371799e2dd01 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:12.067701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:12.068599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:12.068880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:12.069156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] PATH_INFO: `/v3/users/2fbcc3bc0eec458fb4936a1cba504154` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:12.070464 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbcc3bc0eec458fb4936a1cba504154)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:12.072466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:12.124143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbcc3bc0eec458fb4936a1cba504154'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.131559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbcc3bc0eec458fb4936a1cba504154'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.140201 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbcc3bc0eec458fb4936a1cba504154'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.140811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbcc3bc0eec458fb4936a1cba504154'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.153638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbcc3bc0eec458fb4936a1cba504154'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.164006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1225/2469] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:11 2022] DELETE /identity/v3/users/2fbcc3bc0eec458fb4936a1cba504154 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:12.167008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:12.167542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:12.167877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:12.193762 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:12.195598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:12.264402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1245/2470] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:45:12.274972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:12.276433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:12.295273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:12.338898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3d71-c6fa-47c3-9ed4-2ba7020af677 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:12.342686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:12.343475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:12.343901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:12.344239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:12.354882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:12.356453 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:12.367269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1226/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:12.660751 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:12.663512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:12.684009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b5c69-4386-4c60-94e1-4b9ccedf77d7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:12.691891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:12.692922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:12.693211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:12.693488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] PATH_INFO: `/v3/projects/a257d1a49cfe48afb5b3b3fc87e23f6e` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:12.694700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a257d1a49cfe48afb5b3b3fc87e23f6e)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:12.696680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:12.744599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:12.761682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a257d1a49cfe48afb5b3b3fc87e23f6e', 'request_id': 'req-8944aa4e-0172-4c85-a2e8-087ff825b9f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.768585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a257d1a49cfe48afb5b3b3fc87e23f6e', 'request_id': 'req-8944aa4e-0172-4c85-a2e8-087ff825b9f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.775557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a257d1a49cfe48afb5b3b3fc87e23f6e', 'request_id': 'req-8944aa4e-0172-4c85-a2e8-087ff825b9f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.792294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] The token cache is being invalidate because project a257d1a49cfe48afb5b3b3fc87e23f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:12.792737 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.793421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.797105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1246/2472] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:12 2022] DELETE /identity/v3/projects/a257d1a49cfe48afb5b3b3fc87e23f6e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:12.802216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:12.813569 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf5fae-8d5a-47f9-989e-8b7a08b2be68 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:12.903449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:12.904366 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:12.904646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:12.905097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] PATH_INFO: `/v3/users/a900fc017c844213a552ef758f02b04f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:12.906376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a900fc017c844213a552ef758f02b04f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:12.908638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:12.979838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a900fc017c844213a552ef758f02b04f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:12.988945 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a900fc017c844213a552ef758f02b04f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.000866 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a900fc017c844213a552ef758f02b04f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.002543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a900fc017c844213a552ef758f02b04f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.014694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3a31fe92-3b44-4e71-8409-fcf637785046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a900fc017c844213a552ef758f02b04f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.020579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1227/2473] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:12 2022] DELETE /identity/v3/users/a900fc017c844213a552ef758f02b04f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:13.307231 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.308754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:13.331350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aa4e-0172-4c85-a2e8-087ff825b9f7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.389003 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.390111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.390407 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.390663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] PATH_INFO: `/v3/projects/65f76d3d9ce34d15b713e5313618558c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.393044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f76d3d9ce34d15b713e5313618558c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.395475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.446225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f76d3d9ce34d15b713e5313618558c', 'request_id': 'req-fc069b3d-1b20-4215-83fa-aa722455b1c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.451878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f76d3d9ce34d15b713e5313618558c', 'request_id': 'req-fc069b3d-1b20-4215-83fa-aa722455b1c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.459946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f76d3d9ce34d15b713e5313618558c', 'request_id': 'req-fc069b3d-1b20-4215-83fa-aa722455b1c3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.473502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] The token cache is being invalidate because project 65f76d3d9ce34d15b713e5313618558c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:13.473820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.474412 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fc069b3d-1b20-4215-83fa-aa722455b1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:13.476000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1247/2474] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:13 2022] DELETE /identity/v3/projects/65f76d3d9ce34d15b713e5313618558c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:13.481634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.482016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.482483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.501163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:13.502441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:13.536709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:13.566966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1228/2475] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:13.574700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.575002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.575271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.594011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:13.595207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:13.603550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1248/2476] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:13.607905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.617847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434046c-21f0-4ae0-9f34-0bdb9605c929 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.623015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.623695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.624010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.624280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.625010 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:13.625311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.626909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.638543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1229/2477] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:13.642842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.652115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6362a-1b64-4821-b9b0-de624d5603bb None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.657307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.657927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.658203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.658507 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.659203 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.661160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.689405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1249/2478] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:13 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:13.695015 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.705525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9717-7719-46e4-a477-3dc62e7214bb admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.761979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.762661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.762953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.763240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.763977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.766216 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.788024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1230/2479] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:13 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:13.792252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.802902 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05251f3-b848-4062-97cf-1b646d015aee admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.808962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.809618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.809894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.810164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.810883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.812564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.824229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1250/2480] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:13.828634 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.840084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebaa62-050d-4747-acd9-3185f974186c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.846135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.846800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.847086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.847365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.848139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.849771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8696f-6e70-421e-aec0-0a2ecd21bb1a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.860653 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1231/2481] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:13.865023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:13.875593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277e31-d6a4-4e84-8370-f09c649e4d1a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:13.880830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:13.881722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.882005 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.882271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] PATH_INFO: `/v3/projects/1270cd4bd2e84706bcd566669c8c11d6/users/57a937ca0cc9401198fff432f1be3ef2/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.890537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:13.898085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1270cd4bd2e84706bcd566669c8c11d6, user_id=57a937ca0cc9401198fff432f1be3ef2, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:13.901313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:13.915606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1251/2482] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:13 2022] PUT /identity/v3/projects/1270cd4bd2e84706bcd566669c8c11d6/users/57a937ca0cc9401198fff432f1be3ef2/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:13.925851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:13.926141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:13.926417 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:13.952795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] MFA Rules not processed for user `57a937ca0cc9401198fff432f1be3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:13.953996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:14.019716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1232/2483] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:14.024353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.091958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241372ad-bd93-43ae-87c9-a6461337fe77 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.097356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.098181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.098529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.098778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.099513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.101452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.130470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1252/2484] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:14 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:14.134570 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.145183 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b059-1723-42c1-8711-68d78354bcc3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.177380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:14.205190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.205863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.206139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.206409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.207463 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.209399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.233742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1233/2485] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:14 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:14.237786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.248007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321858a0-af21-4427-981b-578d2a2fbce4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.252861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.253517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.253799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.254076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.254833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.256459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.267368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1253/2486] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:14.271431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.282034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd0b0-f536-454a-a867-c995ccc4711d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.287846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.288709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.288987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.289275 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] PATH_INFO: `/v3/projects/f44903665ea9482a8310827aed91dc80/users/be393f298ce34deaaff3f40b926cce1b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.307499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44903665ea9482a8310827aed91dc80, user_id=be393f298ce34deaaff3f40b926cce1b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.310254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.325268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1234/2487] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:14 2022] PUT /identity/v3/projects/f44903665ea9482a8310827aed91dc80/users/be393f298ce34deaaff3f40b926cce1b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:14.329676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.340567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d576384-8fb0-4fa9-be67-2565c7ca08d5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.399014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.399719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.399997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.400271 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.401001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.402610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdad2f-9c18-4c04-aa17-e28474403695 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.412899 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1254/2488] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:14.417414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.427992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2b04-1733-4c3d-b2f2-bc444f0f74a9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.433112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.433989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.434269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.434543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] PATH_INFO: `/v3/projects/f44903665ea9482a8310827aed91dc80/users/be393f298ce34deaaff3f40b926cce1b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.436627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44903665ea9482a8310827aed91dc80, user_id=be393f298ce34deaaff3f40b926cce1b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.439272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.449589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1235/2489] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:14 2022] PUT /identity/v3/projects/f44903665ea9482a8310827aed91dc80/users/be393f298ce34deaaff3f40b926cce1b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:14.461293 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.461588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.461855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.492972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] MFA Rules not processed for user `be393f298ce34deaaff3f40b926cce1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:14.494211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:14.539895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:14.566411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1255/2490] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:14.578578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.581580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:14.648543 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f534c-dd12-4065-834a-26bc31899304 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.653126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.653666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.653968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.654237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.664812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.666281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.676268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1236/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:14.751299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:14.761674 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e8c4-6890-4755-a2b4-22896ba7d234 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:14.765794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:14.766435 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:14.766720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:14.766986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:14.823442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:14.824892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:14.836108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1256/2492] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:15.642108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:15.644285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:15.751207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b748bb-e95d-4e44-b2f1-ebcb5019632c service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:15.758997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:15.759716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:15.760003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:15.760276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:15.763258 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:15.780127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:15.781938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251bd4f-a17b-48ac-934e-818bf7284370 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:15.803262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1237/2493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:17.639054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:17.701612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45f3bc-7baf-4c1e-8bbf-80fa5e0e453d service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:17.706370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:17.707612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:17.707896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:17.708175 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] PATH_INFO: `/v3/users/57a937ca0cc9401198fff432f1be3ef2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:17.709391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a937ca0cc9401198fff432f1be3ef2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:17.711329 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:17.777438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a937ca0cc9401198fff432f1be3ef2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:17.788664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a937ca0cc9401198fff432f1be3ef2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:17.789651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a937ca0cc9401198fff432f1be3ef2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:17.798594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a937ca0cc9401198fff432f1be3ef2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:17.799857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a937ca0cc9401198fff432f1be3ef2'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:17.826247 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:17.834348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1257/2494] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:17 2022] DELETE /identity/v3/users/57a937ca0cc9401198fff432f1be3ef2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:17.839833 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:17.840268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:17.840410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:17.862144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:17.863935 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:17.876212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:17.939127 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1238/2495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:17.957063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:17.958668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:18.018934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad9bd-f0e2-4e4c-a553-30018d95ed32 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:18.022763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:18.023456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:18.023742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:18.024107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:18.033493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:18.034943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:18.044545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1258/2496] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:18.541699 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:18.543349 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:18.560433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005423f-bd27-4b62-b534-002e626e0397 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:18.567681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:18.568660 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:18.568983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:18.569352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] PATH_INFO: `/v3/projects/1270cd4bd2e84706bcd566669c8c11d6` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:18.570636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1270cd4bd2e84706bcd566669c8c11d6)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:18.573081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:18.631285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1270cd4bd2e84706bcd566669c8c11d6', 'request_id': 'req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.639743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1270cd4bd2e84706bcd566669c8c11d6', 'request_id': 'req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.645188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1270cd4bd2e84706bcd566669c8c11d6', 'request_id': 'req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.657890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] The token cache is being invalidate because project 1270cd4bd2e84706bcd566669c8c11d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:18.658182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.658873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.660490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1239/2497] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:18 2022] DELETE /identity/v3/projects/1270cd4bd2e84706bcd566669c8c11d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:18.664664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:18.674456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e75e5-b1fc-4031-9027-b1b2be87036d service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:18.740163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:18.741519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:18.741829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:18.742129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] PATH_INFO: `/v3/users/be393f298ce34deaaff3f40b926cce1b` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:18.743629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be393f298ce34deaaff3f40b926cce1b)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:18.745610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:18.800877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be393f298ce34deaaff3f40b926cce1b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.807857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be393f298ce34deaaff3f40b926cce1b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.808655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be393f298ce34deaaff3f40b926cce1b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.817398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be393f298ce34deaaff3f40b926cce1b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.818080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-177021c7-9b22-475e-beb0-b8c8beaeff29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be393f298ce34deaaff3f40b926cce1b'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:18.836939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1259/2498] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:18 2022] DELETE /identity/v3/users/be393f298ce34deaaff3f40b926cce1b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:19.133843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.135330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:19.148862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb0d1-67bf-4be0-81ea-6c161e9fbbce admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.205007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.205901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.206179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.206449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] PATH_INFO: `/v3/projects/f44903665ea9482a8310827aed91dc80` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.208048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44903665ea9482a8310827aed91dc80)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.209981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.253575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:19.261260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44903665ea9482a8310827aed91dc80', 'request_id': 'req-d9b9db3d-6f9c-440a-984b-73fce7203fca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:19.270081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44903665ea9482a8310827aed91dc80', 'request_id': 'req-d9b9db3d-6f9c-440a-984b-73fce7203fca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:19.276071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44903665ea9482a8310827aed91dc80', 'request_id': 'req-d9b9db3d-6f9c-440a-984b-73fce7203fca'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:19.287500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] The token cache is being invalidate because project f44903665ea9482a8310827aed91dc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:19.287788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:19.288503 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-d9b9db3d-6f9c-440a-984b-73fce7203fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:19.290338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1240/2499] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:19 2022] DELETE /identity/v3/projects/f44903665ea9482a8310827aed91dc80 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:19.296442 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.296733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.297012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.316149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:19.317348 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:19.335417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:19.386119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1260/2500] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:19.393898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.394187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.394466 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.413621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:19.414832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:19.423244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1241/2501] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:19.427611 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.437274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f739c-1575-4178-93cc-8113ce5c1c14 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.442111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.442764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.443041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.443311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.444063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:19.444366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.445975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.458371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1261/2502] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:19.462946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.472938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029488e-824b-4bce-894b-f4e87a1a2ae9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.478559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.479281 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.479622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.479898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.480736 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.482680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.518462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1242/2503] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:19.522212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.532013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d331-2ab5-405e-8d18-ad60473ff29e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.590335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.590980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.591262 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.591573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.592327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.594242 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.615719 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1262/2504] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:19.619942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.630779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c09b-75e3-4eba-805a-b4acaf3d500c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.636006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.636678 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.636953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.637221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.637950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.639671 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.650696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1243/2505] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:19.654410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.664521 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ccad7-40fe-4fc0-ae1c-77211a51e882 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.669309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.669972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.670255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.670629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.671504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.673136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9159877-c5b2-46c6-9e12-a07bd040bf24 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.683071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1263/2506] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:19.687099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.697016 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b442cc-df47-45e2-8aba-7a10c40fbb80 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.701795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.702760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.702986 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.703236 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] PATH_INFO: `/v3/projects/e1313c45658449ff9aaf50c89c555e32/users/f7223e3a9e774608985e912ddf0eed98/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.718715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1313c45658449ff9aaf50c89c555e32, user_id=f7223e3a9e774608985e912ddf0eed98, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.721427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.737537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1244/2507] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:19 2022] PUT /identity/v3/projects/e1313c45658449ff9aaf50c89c555e32/users/f7223e3a9e774608985e912ddf0eed98/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:19.748926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.749265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.749546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.776540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] MFA Rules not processed for user `f7223e3a9e774608985e912ddf0eed98`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:19.777979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:19.844004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1264/2508] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:19.848911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.912796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411936-279e-47ef-a0b2-8a3a958b7a85 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.917939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:19.918598 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:19.918884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:19.919157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:19.919913 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:19.921813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:19.952332 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1245/2509] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:19.956527 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:19.968634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee8252-41f6-475f-a8a0-9c3ebc7ee2e4 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:19.981301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:20.026621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.027215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.027526 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.027804 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.028522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.030523 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.050990 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1265/2510] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:19 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:20.055011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.065969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ac3a-9180-4bbf-8c83-af1b0abc0316 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.071530 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.072191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.072472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.072745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.073504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.075180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.086848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1246/2511] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:20.091705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.102732 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2bd36-fc29-4cca-8272-d07162615c91 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.107815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.109046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.109759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.109759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] PATH_INFO: `/v3/projects/cdda524c869b43679e7c3abf96e66ff7/users/4e68730703f94b7a9368a8a14806bc66/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.127600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdda524c869b43679e7c3abf96e66ff7, user_id=4e68730703f94b7a9368a8a14806bc66, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.130234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.143244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1266/2512] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:20 2022] PUT /identity/v3/projects/cdda524c869b43679e7c3abf96e66ff7/users/4e68730703f94b7a9368a8a14806bc66/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:20.147189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.157261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9c0cf-bbbb-4563-a18c-a33bf1312b8b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.191283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:20.216638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.217307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.217624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.217897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.218627 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.220269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f8c3-b621-408d-b8ac-b434af0f6caf admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.233556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1247/2513] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:20.234981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.245905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaa0a7-1087-4f9c-bc74-648d954c0f90 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.251416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.252399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.252748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.253030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] PATH_INFO: `/v3/projects/cdda524c869b43679e7c3abf96e66ff7/users/4e68730703f94b7a9368a8a14806bc66/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.255208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdda524c869b43679e7c3abf96e66ff7, user_id=4e68730703f94b7a9368a8a14806bc66, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.258051 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.269070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1267/2514] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:20 2022] PUT /identity/v3/projects/cdda524c869b43679e7c3abf96e66ff7/users/4e68730703f94b7a9368a8a14806bc66/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:20.279324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.279618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.279955 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.310214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] MFA Rules not processed for user `4e68730703f94b7a9368a8a14806bc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:20.311506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:20.380114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1248/2515] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:20.392414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.394455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:20.455587 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624753d-d101-493e-a80d-2ce228eb47e9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.460018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.460662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.460921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.461228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.471570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.473017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d06c-74d2-4ad0-8bf5-2a74ce1c82dd service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.483571 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1268/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:20.529832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:20.531365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:20.544865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23368cf-6c09-4668-9368-deb8161fdac9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:20.549003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:20.549652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:20.549930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:20.550200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:20.613352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:20.614831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:20.626160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1249/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:23.048080 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:23.048575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:23.048698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:23.066476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:23.067691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:23.126997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1269/2518] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:23.168646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:23.170554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:23.237170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:23.258853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8299416-b60d-45cc-8a4c-d4ee5a05a0fc service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:23.264395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:23.265157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:23.265435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:23.265715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:23.274069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:23.275708 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dff16-ff79-4f56-bf26-791215639754 service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:23.283800 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1250/2519] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:45:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:45:24.109633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:24.128997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:24.175771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37adfb-5a60-4e58-b61c-aef45db4129f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:24.180565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:24.181451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:24.181733 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:24.182008 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] PATH_INFO: `/v3/users/f7223e3a9e774608985e912ddf0eed98` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:24.183259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7223e3a9e774608985e912ddf0eed98)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:24.185356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:24.232323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7223e3a9e774608985e912ddf0eed98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.239504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7223e3a9e774608985e912ddf0eed98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.240180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7223e3a9e774608985e912ddf0eed98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.248341 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7223e3a9e774608985e912ddf0eed98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.249275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7223e3a9e774608985e912ddf0eed98'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.267790 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1270/2520] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:24 2022] DELETE /identity/v3/users/f7223e3a9e774608985e912ddf0eed98 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:24.272355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:24.272839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:24.272950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:24.290841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:24.292029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:24.355817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1251/2521] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:45:24.365564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:24.367074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:24.425535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497197b-be16-457d-af39-be9b347ca2d1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:24.429446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:24.430084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:24.430364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:24.430633 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:24.440648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:24.442142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:24.453159 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1271/2522] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:24.767705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:24.769170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:24.783523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204a5c-d115-48ef-a9a3-86d52a380f2d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:24.790014 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:24.793113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:24.793352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:24.794786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] PATH_INFO: `/v3/projects/e1313c45658449ff9aaf50c89c555e32` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:24.796178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1313c45658449ff9aaf50c89c555e32)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:24.798189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:24.847125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1313c45658449ff9aaf50c89c555e32', 'request_id': 'req-724bc77c-aebf-470a-9e06-9568c1bbde51'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.856250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1313c45658449ff9aaf50c89c555e32', 'request_id': 'req-724bc77c-aebf-470a-9e06-9568c1bbde51'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.862654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1313c45658449ff9aaf50c89c555e32', 'request_id': 'req-724bc77c-aebf-470a-9e06-9568c1bbde51'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.874019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] The token cache is being invalidate because project e1313c45658449ff9aaf50c89c555e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:24.874311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.874967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:24.876811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1252/2523] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:24 2022] DELETE /identity/v3/projects/e1313c45658449ff9aaf50c89c555e32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:24.880602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:24.890459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69968fcf-fbb7-42d7-b56a-e321aab012b1 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:24.933509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:24.955379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:24.956072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:24.956539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:24.957190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] PATH_INFO: `/v3/users/4e68730703f94b7a9368a8a14806bc66` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:24.958475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e68730703f94b7a9368a8a14806bc66)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:24.960932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:25.028970 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e68730703f94b7a9368a8a14806bc66'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.039894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e68730703f94b7a9368a8a14806bc66'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.040688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e68730703f94b7a9368a8a14806bc66'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.051919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e68730703f94b7a9368a8a14806bc66'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.053457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-58ac18f9-0bc8-471d-a234-16a35d8b4a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e68730703f94b7a9368a8a14806bc66'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.078748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1272/2524] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:24 2022] DELETE /identity/v3/users/4e68730703f94b7a9368a8a14806bc66 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:25.493834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:25.495350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:25.513052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc77c-aebf-470a-9e06-9568c1bbde51 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:25.580810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:25.581911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:25.582191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:25.582482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] PATH_INFO: `/v3/projects/cdda524c869b43679e7c3abf96e66ff7` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:25.583690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdda524c869b43679e7c3abf96e66ff7)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:25.585612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:25.587303 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:25.657857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdda524c869b43679e7c3abf96e66ff7', 'request_id': 'req-dd046572-835d-4860-8108-b6794241b52a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.668006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdda524c869b43679e7c3abf96e66ff7', 'request_id': 'req-dd046572-835d-4860-8108-b6794241b52a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.679733 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdda524c869b43679e7c3abf96e66ff7', 'request_id': 'req-dd046572-835d-4860-8108-b6794241b52a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.691612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] The token cache is being invalidate because project cdda524c869b43679e7c3abf96e66ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:25.692110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.692770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-dd046572-835d-4860-8108-b6794241b52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:25.694933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1253/2525] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:25 2022] DELETE /identity/v3/projects/cdda524c869b43679e7c3abf96e66ff7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:25.699727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:25.700215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:25.700302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:25.719157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:25.720405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:25.782687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1273/2526] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:25.790648 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:25.790959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:25.791234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:25.810296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:25.811549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:25.820284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1254/2527] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:25.824607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:25.835093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3b40-7f37-40ed-a0ec-0f39e3f6283b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:25.839774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:25.840517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:25.840869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:25.841222 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:25.842012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:25.842432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:25.844153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:25.855903 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1274/2528] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:25.860221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:25.869796 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cabcc7-84ed-429c-9ab7-a6fe1b28dccd None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:25.875534 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:25.876272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:25.876623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:25.876967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:25.877769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:25.880626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:25.910304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1255/2529] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:25 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:25.914836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:25.932687 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c99f-5f0d-4bfa-980c-5f542ccc1c55 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:26.004649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:26.030668 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:26.032584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.033229 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.033781 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.034835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:26.037818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:26.067716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1275/2530] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:25 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:45:26.071979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:26.083151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa378c-01df-4aaa-b0f2-3dd6f8e08863 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:26.089406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:26.090382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.090868 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.091583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.092930 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:26.094949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:26.116134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:26.123423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1256/2531] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:45:26.127827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277d96-6f1b-4d17-b343-e78b1fc96ddf admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:26.132813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:26.133482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.133764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.134861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.135711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:26.138476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43fa5f-897f-4cf1-9aea-b6432f2cafc7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:26.155681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1276/2532] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:26.159732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:26.171878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219a06-d01b-48f7-9692-2169f5f53ec5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:26.176806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:26.177695 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.177971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.178243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] PATH_INFO: `/v3/projects/82d65546b2f1449a8edd7b0cba1edb3a/users/e3dd674ebcbf41d79d1d207f330cf46f/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.195363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d65546b2f1449a8edd7b0cba1edb3a, user_id=e3dd674ebcbf41d79d1d207f330cf46f, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:26.198197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:26.225878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1257/2533] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:26 2022] PUT /identity/v3/projects/82d65546b2f1449a8edd7b0cba1edb3a/users/e3dd674ebcbf41d79d1d207f330cf46f/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:26.228135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.228465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.228717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.261917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] MFA Rules not processed for user `e3dd674ebcbf41d79d1d207f330cf46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:26.263144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:26.343387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1277/2534] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:26.351407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:26.353468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:26.421100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f13c-ee64-4b5e-ad5b-48887dfbb9f7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:26.433981 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:26.435375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:26.435662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:26.435970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:26.463421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:26.464911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:26.479846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1258/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:30.336858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:30.339036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:30.406250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:30.407987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:30.438416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54b9bb-74c9-41c6-8bae-fcbc18484ecc None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:30.443441 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:30.444063 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:30.444347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:30.444620 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:30.444968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:30.446489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:30.459839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:30.461562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:30.471846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1278/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:30.484459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de783c-3107-406d-8dbe-1b00b3b73a35 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:30.489376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:30.490266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:30.490544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:30.490815 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] PATH_INFO: `/v3/users/157d5f6570024c468db34ae0ca7ad622` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:30.492041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157d5f6570024c468db34ae0ca7ad622)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:30.494011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:30.541099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157d5f6570024c468db34ae0ca7ad622'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.547901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157d5f6570024c468db34ae0ca7ad622'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.556642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157d5f6570024c468db34ae0ca7ad622'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.557185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157d5f6570024c468db34ae0ca7ad622'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.569535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157d5f6570024c468db34ae0ca7ad622'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.576211 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1259/2537] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:30 2022] DELETE /identity/v3/users/157d5f6570024c468db34ae0ca7ad622 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:30.756878 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:30.770081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe1f9-9f13-4223-89a1-1b045ab19697 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:30.814794 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:30.831446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:30.832632 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:30.832909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:30.833181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] PATH_INFO: `/v3/projects/28b455b8dd8b4910803ac509413a97e6` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:30.834351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b455b8dd8b4910803ac509413a97e6)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:30.836321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:30.883818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b455b8dd8b4910803ac509413a97e6', 'request_id': 'req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.891047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b455b8dd8b4910803ac509413a97e6', 'request_id': 'req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.898354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b455b8dd8b4910803ac509413a97e6', 'request_id': 'req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.916017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] The token cache is being invalidate because project 28b455b8dd8b4910803ac509413a97e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:30.916664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.917440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:30.919255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1279/2538] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:30 2022] DELETE /identity/v3/projects/28b455b8dd8b4910803ac509413a97e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:30.923550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:30.924994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:30.938060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe907-113b-4913-b22e-3af87432dab4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:31.007908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:31.008702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:31.008978 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:31.009247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] PATH_INFO: `/v3/users/bbb09786cd2640e6955e449c25a0b7a3` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:31.010458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb09786cd2640e6955e449c25a0b7a3)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:31.012433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:31.062608 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb09786cd2640e6955e449c25a0b7a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.064638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:31.070897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb09786cd2640e6955e449c25a0b7a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.079612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb09786cd2640e6955e449c25a0b7a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.080235 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb09786cd2640e6955e449c25a0b7a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.101606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7ac9c06f-e43e-4e8f-91ba-84c4fb9d6dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb09786cd2640e6955e449c25a0b7a3'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.108253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1260/2539] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:30 2022] DELETE /identity/v3/users/bbb09786cd2640e6955e449c25a0b7a3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:45:31.337172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:31.338743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:31.354207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09bb98-111c-4e7b-8c32-6312d1ca2a6e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:31.422948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:31.423860 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:31.424148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:31.424427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] PATH_INFO: `/v3/projects/f26c3baf01204f74b713049cb489ee26` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:31.425623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26c3baf01204f74b713049cb489ee26)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:31.427597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:31.480596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26c3baf01204f74b713049cb489ee26', 'request_id': 'req-1beed347-3d6f-454a-bfa1-2613446ee5a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.486800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26c3baf01204f74b713049cb489ee26', 'request_id': 'req-1beed347-3d6f-454a-bfa1-2613446ee5a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.493180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26c3baf01204f74b713049cb489ee26', 'request_id': 'req-1beed347-3d6f-454a-bfa1-2613446ee5a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.507773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] The token cache is being invalidate because project f26c3baf01204f74b713049cb489ee26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:31.508062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.510102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:31.512282 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1280/2540] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:31 2022] DELETE /identity/v3/projects/f26c3baf01204f74b713049cb489ee26 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:31.561097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:31.561661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:31.561661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:31.581977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:31.583267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:31.651902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1261/2541] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:31.664458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:31.666028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:31.674327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:31.763135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed347-3d6f-454a-bfa1-2613446ee5a8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:31.770070 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:31.771586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:31.771977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:31.772663 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:31.784561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:31.786423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d938-c7c6-4d21-8d21-b9a7d1e34033 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:31.796335 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1281/2542] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:45:41.645164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=36,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:41.792830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=30 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:46.715850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:46.717301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:46.784679 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af32a-cd16-494a-bd75-393c8bcb1b9a None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:46.790173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:46.791095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:46.791416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:46.791696 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] PATH_INFO: `/v3/users/e3dd674ebcbf41d79d1d207f330cf46f` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:46.793044 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dd674ebcbf41d79d1d207f330cf46f)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:46.795129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:46.844979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dd674ebcbf41d79d1d207f330cf46f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:46.852136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dd674ebcbf41d79d1d207f330cf46f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:46.860359 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dd674ebcbf41d79d1d207f330cf46f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:46.861074 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dd674ebcbf41d79d1d207f330cf46f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:46.873126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dd674ebcbf41d79d1d207f330cf46f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:46.879079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1262/2543] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:46 2022] DELETE /identity/v3/users/e3dd674ebcbf41d79d1d207f330cf46f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:46.883545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:46.884014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:46.884261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:46.904535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:46.906265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:46.975752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1282/2544] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:46.985997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:46.987610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:47.048424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050e9-6878-4ba2-b572-a596d0711bb9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.052182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.052846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.053731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.053731 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.062872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.064363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9add3dc-5331-4755-b6d0-6c91eac98062 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.074426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1263/2545] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:47.371679 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.373258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:47.388728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766c4a7-8efa-480c-9c9c-290a718716da None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.394456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.395786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.396176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.396659 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] PATH_INFO: `/v3/projects/82d65546b2f1449a8edd7b0cba1edb3a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.398036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d65546b2f1449a8edd7b0cba1edb3a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.400357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.448818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d65546b2f1449a8edd7b0cba1edb3a', 'request_id': 'req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:47.454856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d65546b2f1449a8edd7b0cba1edb3a', 'request_id': 'req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:47.461768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d65546b2f1449a8edd7b0cba1edb3a', 'request_id': 'req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:47.478877 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] The token cache is being invalidate because project 82d65546b2f1449a8edd7b0cba1edb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:47.479953 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:47.480742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bfce58a1-ae51-47de-b2dd-17aa5b2ecf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:47.483030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1283/2546] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:47 2022] DELETE /identity/v3/projects/82d65546b2f1449a8edd7b0cba1edb3a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:47.487871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.488165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.488919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.506856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:47.508207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:47.527683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:47.574186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1264/2547] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:47.582779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.583077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.583361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.601782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:47.603000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:47.611013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1284/2548] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:47.615214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.625222 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4f92-77f6-4767-82a8-8bc6c6b57214 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.634423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.635115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.635427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.635704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.636441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:47.636749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.638426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.655605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1265/2549] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:47.656792 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.671324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e8a7-ecee-4ea2-8b33-11712449e1a3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.676083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.676750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.677032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.677307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.678127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.680130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.720597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1285/2550] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:47 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:47.721791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.731904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba99fa-e032-4f61-b413-d1f613c33085 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.791177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.792314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.792649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.792845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.793529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.795525 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.819674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1266/2551] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:47 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:47.821030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.832255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc61cb-8bd0-4839-9bd5-6c62ff90856d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.837266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.837930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.838214 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.838513 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.839237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.840891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.852044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1286/2552] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:47.856213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.866536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2564a5-36b7-4517-8b91-accc054ef1f4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.871143 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.871834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.872117 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.872394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.873259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.874901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02344d2d-6b37-49b8-a519-4eba2fdc603d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.887999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1267/2553] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:47.892123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:47.902414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7517b-3b44-487f-8bed-b35f33f80ac7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:47.907448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:47.908351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.908631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.908905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] PATH_INFO: `/v3/projects/8c9edec08a6e4bd591b03038707200b7/users/57ad48eb9a1b43d8b6c94a3e080a7a9c/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.923891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9edec08a6e4bd591b03038707200b7, user_id=57ad48eb9a1b43d8b6c94a3e080a7a9c, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:47.926542 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:47.942147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1287/2554] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:47 2022] PUT /identity/v3/projects/8c9edec08a6e4bd591b03038707200b7/users/57ad48eb9a1b43d8b6c94a3e080a7a9c/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:47.953635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c527-20e1-4738-bf2e-8c179a937764 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:47.954289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c527-20e1-4738-bf2e-8c179a937764 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:47.954711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c527-20e1-4738-bf2e-8c179a937764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:47.983103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-68b3c527-20e1-4738-bf2e-8c179a937764 None None] MFA Rules not processed for user `57ad48eb9a1b43d8b6c94a3e080a7a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:47.984393 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-68b3c527-20e1-4738-bf2e-8c179a937764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:48.052306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1268/2555] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:48.063195 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:48.065268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:48.079814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:48.137290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4af14-3fc6-4bec-a712-a69d21632de9 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:48.141073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:48.141730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:48.142013 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:48.142291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:48.150843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:48.152344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:48.161273 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1288/2556] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:49.216782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:49.217282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:49.217376 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:49.235149 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:49.236388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:49.249886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:49.296858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1269/2557] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:49.308840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:49.310469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:49.385263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b40a-de50-4a33-a57b-5008c17f7612 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:49.391531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:49.392189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:49.392469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:49.392742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:49.401590 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:49.403186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f314950-961f-4f7f-8744-5da6d5072d3f service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:49.411502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1289/2558] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:45:58.516424 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:58.580208 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10a3f-e997-40f8-b38d-e3020110001e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:58.585668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:58.586542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:58.586822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:58.587090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] PATH_INFO: `/v3/users/57ad48eb9a1b43d8b6c94a3e080a7a9c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:58.588351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ad48eb9a1b43d8b6c94a3e080a7a9c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:58.590317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:58.648379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ad48eb9a1b43d8b6c94a3e080a7a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:58.655527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ad48eb9a1b43d8b6c94a3e080a7a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:58.664643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ad48eb9a1b43d8b6c94a3e080a7a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:58.665342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ad48eb9a1b43d8b6c94a3e080a7a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:58.678339 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ad48eb9a1b43d8b6c94a3e080a7a9c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:58.684669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1270/2559] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:45:58 2022] DELETE /identity/v3/users/57ad48eb9a1b43d8b6c94a3e080a7a9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:58.689325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:58.689840 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:58.689943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:58.707160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:58.708373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:58.766815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1290/2560] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:58.777124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:58.778561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:58.843714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:58.856839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519066e6-1324-4382-bc07-ead5d689ce3a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:58.860966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:58.861685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:58.862058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:58.862440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:58.871755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:58.873344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdec5a-3f05-4b0d-ae1c-599ae2b9ed96 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:58.883286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1271/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:59.170157 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.171651 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:59.183711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32f2e1-1af2-4fba-9175-dd4ea4683ee3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.190241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.191129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.191465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.191740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] PATH_INFO: `/v3/projects/8c9edec08a6e4bd591b03038707200b7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.193393 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9edec08a6e4bd591b03038707200b7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.195610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.238225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:59.245863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9edec08a6e4bd591b03038707200b7', 'request_id': 'req-5af82821-9eaa-4e24-8788-22428ab77a33'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:59.251510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9edec08a6e4bd591b03038707200b7', 'request_id': 'req-5af82821-9eaa-4e24-8788-22428ab77a33'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:59.257656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9edec08a6e4bd591b03038707200b7', 'request_id': 'req-5af82821-9eaa-4e24-8788-22428ab77a33'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:59.271664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] The token cache is being invalidate because project 8c9edec08a6e4bd591b03038707200b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:45:59.272139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:59.272885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5af82821-9eaa-4e24-8788-22428ab77a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:45:59.274650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1291/2562] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:45:59 2022] DELETE /identity/v3/projects/8c9edec08a6e4bd591b03038707200b7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:59.279838 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.280199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.280483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.298317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:59.299555 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:59.360445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1272/2563] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:59.372256 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.372741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.373001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.392636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:59.393872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:59.403166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1292/2564] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:59.407533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.417761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a06b-cc57-4cb0-9459-17c9c6edee8c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.423855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.424522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.424803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.425077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.425841 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:45:59.426112 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.427779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.441167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1273/2565] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:45:59.448851 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.468156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a197c6a-365e-4a9f-b1a5-178cf3704a99 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.474489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.475198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.475595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.475931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.476736 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.478842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.511612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1293/2566] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:45:59 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:59.516230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.527191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a6db-8076-4800-a5bc-e31da6608086 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.588989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.589675 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.589959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.590233 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.590920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.593003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.613179 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1274/2567] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:45:59 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:45:59.617522 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.627887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5de3-d521-455c-b687-6dbf6ea929f7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.632496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.633166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.633446 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.633716 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.634431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.636079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.646682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1294/2568] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:59.650470 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.661428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e502-6793-4242-883a-5cc4e7aaa258 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.667368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.668027 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.668336 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.668551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.669311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.670959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e02ec-5647-4f29-88e7-fcd38e3e5d33 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.681510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1275/2569] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:45:59.685599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.697301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f5cd9-a6e3-4200-83d0-096a060fe9d3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.702589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.703555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.703834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.704112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] PATH_INFO: `/v3/projects/2bc4a7159fa34affae55ebdbb866f88b/users/7cd2882baad040019be3aa1e554c5905/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.720045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc4a7159fa34affae55ebdbb866f88b, user_id=7cd2882baad040019be3aa1e554c5905, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.722693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.738641 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1295/2570] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:45:59 2022] PUT /identity/v3/projects/2bc4a7159fa34affae55ebdbb866f88b/users/7cd2882baad040019be3aa1e554c5905/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:45:59.749230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8de3-0e41-4254-9198-56fbf2220cf2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.749519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8de3-0e41-4254-9198-56fbf2220cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.749789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8de3-0e41-4254-9198-56fbf2220cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.777790 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8f9b8de3-0e41-4254-9198-56fbf2220cf2 None None] MFA Rules not processed for user `7cd2882baad040019be3aa1e554c5905`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:45:59.779246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8f9b8de3-0e41-4254-9198-56fbf2220cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:59.820510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:59.846879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1276/2571] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:45:59.858041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:59.859848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:59.919813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31e316-72fb-4bd9-86ab-dadf964ea48a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:59.923730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:59.924405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:59.924673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:59.924940 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:59.933889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:59.935547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea48a-9958-47d9-a19a-ddd7703c2131 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:59.944516 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1296/2572] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:01.367982 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ceef-b448-4d60-807b-7ab84e2b3bb2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:01.368461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ceef-b448-4d60-807b-7ab84e2b3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:01.368560 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ceef-b448-4d60-807b-7ab84e2b3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:01.397134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d542ceef-b448-4d60-807b-7ab84e2b3bb2 None None] MFA Rules not processed for user `7cd2882baad040019be3aa1e554c5905`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:01.398496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d542ceef-b448-4d60-807b-7ab84e2b3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:01.417082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1277/2573] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:02.387669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:02.388637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:02.389147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:02.411000 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] MFA Rules not processed for user `0a9f85caf65f431c96f27a7d04734211`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:02.412589 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:02.485112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1297/2574] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:05.060668 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:05.061523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:05.062203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:05.084306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:05.085542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:05.151818 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1278/2575] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:05.164205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:05.165701 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:05.179418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:05.248391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cba9c-a223-44f4-be31-5fd99b0d7175 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:05.254846 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:05.255529 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:05.255810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:05.256079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:05.264982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:05.266572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abff42f-063f-4247-9857-b4ef35562e93 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:05.274891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1298/2576] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:10.422844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:10.424516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:10.484273 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7bd55-f7cb-478c-ab40-f1109592787e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:10.488122 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:10.488773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:10.489051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:10.489323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:10.491227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:10.553557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:10.555034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:10.564385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1279/2577] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:15.271502 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=27 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.095296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.095296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.095296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.114202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:19.115588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.123479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1299/2578] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:19.136030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.149535 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a7ad-5365-4dab-97db-dcc404d009cb service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.155739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.156375 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.156655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.156932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.165658 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.167297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc565d-b26b-48ea-9246-5fc815c378dc service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.175742 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1280/2579] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:19.523905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.525901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.540678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8057-c23e-4b1d-a7a4-6e59ee2111ec None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.545081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.545695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.546099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.546400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.548645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.620955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.622451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.634495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1300/2580] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:19.787031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49e98-8e0e-4528-9412-19c38854f8f4 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.787293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49e98-8e0e-4528-9412-19c38854f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.787638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49e98-8e0e-4528-9412-19c38854f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.806993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e9e49e98-8e0e-4528-9412-19c38854f8f4 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:19.808267 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e9e49e98-8e0e-4528-9412-19c38854f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.816931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1281/2581] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:19.830422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.842900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123df9-2eef-4c06-b1eb-a2c26f11163e service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.848525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.849213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.849506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.849788 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.860580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.862190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.878326 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1301/2582] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:20.164715 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d45dd-9b19-4402-a81c-50d60184b04d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.165230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d45dd-9b19-4402-a81c-50d60184b04d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.165361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d45dd-9b19-4402-a81c-50d60184b04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.183406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e24d45dd-9b19-4402-a81c-50d60184b04d None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.184772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e24d45dd-9b19-4402-a81c-50d60184b04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.191974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1282/2583] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.204188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.215434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ecd3-d5ac-46bc-ae8d-a6f3b2779426 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.220876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.221585 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.221871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.222150 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.230859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.232665 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.241536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1302/2584] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 13:46:20.575469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.575756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.576024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.588792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=100 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.595313 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.596586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.605852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1283/2585] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.617423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.628443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665df8aa-41c8-40a3-a6bf-c30de2bd4f7b service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.633681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.634320 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.634600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.634867 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.644181 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.645808 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.654759 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1303/2586] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:21.320632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.334572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8ce3-f5c0-49a5-8be6-f5aeee184510 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.344499 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.345230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.345820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.347451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.357924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.375875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.378360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956765-4d85-4139-99ba-0f243be8eb13 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.389371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1284/2587] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:23.016925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:23.042068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa49a-e5cf-44bd-9a03-c488335a5033 service swift] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:23.046917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:23.061802 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:23.063662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:23.064155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] PATH_INFO: `/v3/users/7cd2882baad040019be3aa1e554c5905` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.067398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd2882baad040019be3aa1e554c5905)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:23.074747 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:23.164728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd2882baad040019be3aa1e554c5905'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:23.182557 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd2882baad040019be3aa1e554c5905'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:23.183739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd2882baad040019be3aa1e554c5905'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:23.208250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd2882baad040019be3aa1e554c5905'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:23.209549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd2882baad040019be3aa1e554c5905'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:23.246029 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1304/2588] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:23 2022] DELETE /identity/v3/users/7cd2882baad040019be3aa1e554c5905 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:23.250709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:23.251630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:23.252084 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.286072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:23.288108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.391967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1285/2589] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:23.418045 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:23.419460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.460991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:23.554021 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6e20b-c81d-4d02-a735-2fbf00ba2997 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:23.567224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:23.567826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:23.568110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:23.568388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.587107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:23.588862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:23.603140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1305/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:24.140720 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:24.142266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.155726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a098d-66a8-4865-b130-2de7ff1f3613 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.161824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.163626 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.164492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.164921 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] PATH_INFO: `/v3/projects/2bc4a7159fa34affae55ebdbb866f88b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.166436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc4a7159fa34affae55ebdbb866f88b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.168817 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:24.252026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc4a7159fa34affae55ebdbb866f88b', 'request_id': 'req-79802102-c495-4357-bb79-267f039eb602'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.266305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc4a7159fa34affae55ebdbb866f88b', 'request_id': 'req-79802102-c495-4357-bb79-267f039eb602'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.273620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc4a7159fa34affae55ebdbb866f88b', 'request_id': 'req-79802102-c495-4357-bb79-267f039eb602'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.289937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] The token cache is being invalidate because project 2bc4a7159fa34affae55ebdbb866f88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:24.290230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.290897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.293623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1286/2591] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:24 2022] DELETE /identity/v3/projects/2bc4a7159fa34affae55ebdbb866f88b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:27.435087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.436770 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:27.450803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5201-1908-428e-8ebc-149e6694e5b2 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.511076 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.512461 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.512750 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.513055 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] PATH_INFO: `/v3/users/007ce9b8109343e0914efe94c6aa6a89` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.514284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007ce9b8109343e0914efe94c6aa6a89)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.518581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.575447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007ce9b8109343e0914efe94c6aa6a89'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.583569 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007ce9b8109343e0914efe94c6aa6a89'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.584470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007ce9b8109343e0914efe94c6aa6a89'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.595023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007ce9b8109343e0914efe94c6aa6a89'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.595730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-212450f9-c368-4414-a089-228a0c4eba37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007ce9b8109343e0914efe94c6aa6a89'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.615241 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1306/2592] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:27 2022] DELETE /identity/v3/users/007ce9b8109343e0914efe94c6aa6a89 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:27.796000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.798165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:27.819618 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802102-c495-4357-bb79-267f039eb602 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.882360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.883443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.883789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.884125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] PATH_INFO: `/v3/projects/9298bf4635e84993b086309715cc7cbe` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.885467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9298bf4635e84993b086309715cc7cbe)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.887937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.901443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:27.946872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9298bf4635e84993b086309715cc7cbe', 'request_id': 'req-7c1644c2-201b-4d72-8805-df5572ee697b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.983652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9298bf4635e84993b086309715cc7cbe', 'request_id': 'req-7c1644c2-201b-4d72-8805-df5572ee697b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.993557 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9298bf4635e84993b086309715cc7cbe', 'request_id': 'req-7c1644c2-201b-4d72-8805-df5572ee697b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.043072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] The token cache is being invalidate because project 9298bf4635e84993b086309715cc7cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:28.043504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.046610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7c1644c2-201b-4d72-8805-df5572ee697b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.049460 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1287/2593] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:27 2022] DELETE /identity/v3/projects/9298bf4635e84993b086309715cc7cbe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:28.054730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.055122 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.055497 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.084726 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:28.086451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.139930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:28.175939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1307/2594] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:28.186354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317419-f481-4719-93e6-08e27257ea0d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.186721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317419-f481-4719-93e6-08e27257ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.187068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317419-f481-4719-93e6-08e27257ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.209318 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-86317419-f481-4719-93e6-08e27257ea0d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:28.210797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-86317419-f481-4719-93e6-08e27257ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.220761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1288/2595] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:28.225453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.254155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a12a3a-4388-4fc4-8d94-b40159fea140 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.261921 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.262912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.263269 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.263643 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.264743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:28.264943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.267022 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.300274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1308/2596] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:28.300691 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86317419-f481-4719-93e6-08e27257ea0d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.312340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86317419-f481-4719-93e6-08e27257ea0d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.318153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.318917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.319266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.319636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.320544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.322442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.355305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1289/2597] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:28.359700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.369883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b724ec-4bf3-4867-9a75-73849c3f101e admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.464376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.464376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.464376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.464376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.465190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.465190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.494896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1309/2598] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/users => generated 305 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:28.499171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.510713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06f95-b574-449e-bd38-9a5b01d864b9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.516022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.518603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.518740 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.518934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.519726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.521434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.533125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1290/2599] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:28.537440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.547791 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46d1a-bf6a-45c4-9179-6b23d9013c44 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.552388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.553062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.553334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.553608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.554339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.555971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdd460-c8be-4bae-9971-8d0767b0e26a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.566730 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1310/2600] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:28.570900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.583042 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e8e8-7fee-4e98-b8ed-bc679e1d0add admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.588080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.589173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.589458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.589730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] PATH_INFO: `/v3/projects/d9ebf6f03f1d41fea1079bcb99ac036c/users/6232d8eed2bd479092e4102703a9913e/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.605734 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ebf6f03f1d41fea1079bcb99ac036c, user_id=6232d8eed2bd479092e4102703a9913e, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.608475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.624217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1291/2601] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:28 2022] PUT /identity/v3/projects/d9ebf6f03f1d41fea1079bcb99ac036c/users/6232d8eed2bd479092e4102703a9913e/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:28.634744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.635091 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.635400 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.664031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] MFA Rules not processed for user `6232d8eed2bd479092e4102703a9913e`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:28.666494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.693669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.695635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.748198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1311/2602] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:28.752489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.777314 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2607a31-6f19-4f32-b77b-7fc01f6713b1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.782804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.783723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.783990 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.784261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] PATH_INFO: `/v3/users/e7e1bce062244098888ecb72b11ccd88` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.785468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e1bce062244098888ecb72b11ccd88)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.787501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.793618 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:28.828561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7e1a0-843b-4978-af51-5b8cf383b220 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.832633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:28.833454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.834125 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.834408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.834693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.835427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.837467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.840663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e1bce062244098888ecb72b11ccd88'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.848862 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e1bce062244098888ecb72b11ccd88'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.858549 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e1bce062244098888ecb72b11ccd88'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.859310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e1bce062244098888ecb72b11ccd88'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.864757 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1312/2603] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/projects => generated 407 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:28.868647 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.871728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e1bce062244098888ecb72b11ccd88'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:28.877855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1292/2604] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:28 2022] DELETE /identity/v3/users/e7e1bce062244098888ecb72b11ccd88 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:28.933691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3ce8-4807-43c9-a0e6-4ea09c489d78 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.996853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.997528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.997811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.998089 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.998763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.000718 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.030936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1313/2605] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:29.032422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.034326 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.051719 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb49c-ff74-4b22-94e8-2d564947ff29 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.058119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.059515 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.060422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.060686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.061165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.061640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.062611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.064735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.076777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beceb41-268c-4d9f-9d24-7aeb7ab3cc08 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.082532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.083397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.083702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.084220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] PATH_INFO: `/v3/projects/b2fef8d0cb974f35a741c3090fda97f1` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.085308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fef8d0cb974f35a741c3090fda97f1)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.087270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.091310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1293/2606] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:29.096013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.107440 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c47b53-005b-4d33-be15-94482c856e6a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.112446 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.113342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.113623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.113908 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] PATH_INFO: `/v3/projects/54582a46b8df4b74b56fb7abb29632f3/users/603b943ad99d4da68660e30a06d7b76b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.130095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54582a46b8df4b74b56fb7abb29632f3, user_id=603b943ad99d4da68660e30a06d7b76b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.133161 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.143115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fef8d0cb974f35a741c3090fda97f1', 'request_id': 'req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.147099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1294/2607] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:29 2022] PUT /identity/v3/projects/54582a46b8df4b74b56fb7abb29632f3/users/603b943ad99d4da68660e30a06d7b76b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:29.150106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:29.150623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.152528 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fef8d0cb974f35a741c3090fda97f1', 'request_id': 'req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.160906 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fef8d0cb974f35a741c3090fda97f1', 'request_id': 'req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.177517 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] The token cache is being invalidate because project b2fef8d0cb974f35a741c3090fda97f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:29.177800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.178415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.180052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1314/2608] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:29 2022] DELETE /identity/v3/projects/b2fef8d0cb974f35a741c3090fda97f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:29.184062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.185417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.226917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6a8b-4782-4b66-ad71-39b22897ab2b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.235573 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.236826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.237496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.238374 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.240308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.242278 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.250525 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe81ff6-76e2-4bd3-bc0d-004241f204ee admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.254203 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1295/2609] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:29.257213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.258402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.259276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.259836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.259999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.260296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] PATH_INFO: `/v3/users/9fbd59bbb256494c81e2a7f0bbe83ad7` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.262572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbd59bbb256494c81e2a7f0bbe83ad7)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.264943 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.275142 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b33d-4172-49e1-bc84-7f9bed2775ee admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.280245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.281404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.281741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.282076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] PATH_INFO: `/v3/projects/54582a46b8df4b74b56fb7abb29632f3/users/603b943ad99d4da68660e30a06d7b76b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.284123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54582a46b8df4b74b56fb7abb29632f3, user_id=603b943ad99d4da68660e30a06d7b76b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.286877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd90f21-48ee-40dd-b1a7-19c4bfd15aa5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.301008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1296/2610] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:29 2022] PUT /identity/v3/projects/54582a46b8df4b74b56fb7abb29632f3/users/603b943ad99d4da68660e30a06d7b76b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:29.313021 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.313381 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.313725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.322234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbd59bbb256494c81e2a7f0bbe83ad7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.329566 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbd59bbb256494c81e2a7f0bbe83ad7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.330338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbd59bbb256494c81e2a7f0bbe83ad7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.340128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbd59bbb256494c81e2a7f0bbe83ad7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.341580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbd59bbb256494c81e2a7f0bbe83ad7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.345497 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] MFA Rules not processed for user `603b943ad99d4da68660e30a06d7b76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:29.347448 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.368773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1315/2611] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:29 2022] DELETE /identity/v3/users/9fbd59bbb256494c81e2a7f0bbe83ad7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:29.407747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:29.447717 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1297/2612] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:29.470927 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.472495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.535146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab24fae-b61c-42ee-86c9-d22f8edb2b74 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.539979 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.541151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.541493 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.542110 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.558558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:29.571772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.573317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.628062 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.629509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.640149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1316/2613] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:29.659048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9103e6-1fbf-4786-a2e5-765cf7b6b704 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.718414 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.719436 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.719725 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.720070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] PATH_INFO: `/v3/projects/1384cea9a217469faa4e25c0dd55639d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.721341 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1384cea9a217469faa4e25c0dd55639d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.723425 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.785257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1384cea9a217469faa4e25c0dd55639d', 'request_id': 'req-ec77e02c-6230-4b60-a144-546dd927d43f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.795255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1384cea9a217469faa4e25c0dd55639d', 'request_id': 'req-ec77e02c-6230-4b60-a144-546dd927d43f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.806655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1384cea9a217469faa4e25c0dd55639d', 'request_id': 'req-ec77e02c-6230-4b60-a144-546dd927d43f'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.810774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.820344 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ecf7-bf88-4b28-8122-6e31ab152119 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.823789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] The token cache is being invalidate because project 1384cea9a217469faa4e25c0dd55639d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:29.824156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.824933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.826741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1298/2614] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:29 2022] DELETE /identity/v3/projects/1384cea9a217469faa4e25c0dd55639d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:29.904315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.908833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.909168 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.909451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.911914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.991432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.992917 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f013f1-ca51-49df-86d2-9f1bffb5f6f9 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.005313 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1317/2615] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:37.394120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.395713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.431811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:37.474950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e02c-6230-4b60-a144-546dd927d43f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.480728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.481606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.481882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.482166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] PATH_INFO: `/v3/users/6232d8eed2bd479092e4102703a9913e` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.483593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6232d8eed2bd479092e4102703a9913e)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.485522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.542144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6232d8eed2bd479092e4102703a9913e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.548812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6232d8eed2bd479092e4102703a9913e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.556401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6232d8eed2bd479092e4102703a9913e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.557097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6232d8eed2bd479092e4102703a9913e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.568572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6232d8eed2bd479092e4102703a9913e'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.574426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1299/2616] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:37 2022] DELETE /identity/v3/users/6232d8eed2bd479092e4102703a9913e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:37.578959 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.579479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.579579 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.598370 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:37.599629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.662874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1318/2617] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:37.674310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.676039 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.740299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef8c4-9c7f-46d6-aa56-478c1a5d8073 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.746710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.747365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.747663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.747932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.757711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.759153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.769606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1300/2618] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:38.063133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.064599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.081654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3863e-0c84-418a-a664-d8cff914629a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.086844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.087803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.088082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.088347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] PATH_INFO: `/v3/projects/d9ebf6f03f1d41fea1079bcb99ac036c` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.093678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ebf6f03f1d41fea1079bcb99ac036c)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.095624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.097336 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=100 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:38.144588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ebf6f03f1d41fea1079bcb99ac036c', 'request_id': 'req-08a2996b-3f17-4c6a-93c2-39afa48939f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.150264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ebf6f03f1d41fea1079bcb99ac036c', 'request_id': 'req-08a2996b-3f17-4c6a-93c2-39afa48939f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.156695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ebf6f03f1d41fea1079bcb99ac036c', 'request_id': 'req-08a2996b-3f17-4c6a-93c2-39afa48939f7'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.170249 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] The token cache is being invalidate because project d9ebf6f03f1d41fea1079bcb99ac036c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:38.170468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.171108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.173107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1319/2619] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:38 2022] DELETE /identity/v3/projects/d9ebf6f03f1d41fea1079bcb99ac036c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:38.178171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.189831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6bb1-cbfd-46b1-afa0-6697a49155ae service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.240564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:38.254940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.256040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.256360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.256819 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] PATH_INFO: `/v3/users/603b943ad99d4da68660e30a06d7b76b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.258268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=603b943ad99d4da68660e30a06d7b76b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.260250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.313962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603b943ad99d4da68660e30a06d7b76b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.320966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603b943ad99d4da68660e30a06d7b76b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.331730 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603b943ad99d4da68660e30a06d7b76b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.332479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603b943ad99d4da68660e30a06d7b76b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.344288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-ab6ee8b9-4184-483c-9f7e-7089b24ef37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603b943ad99d4da68660e30a06d7b76b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.350397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1301/2620] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:38 2022] DELETE /identity/v3/users/603b943ad99d4da68660e30a06d7b76b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:38.642532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.644073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.657971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2996b-3f17-4c6a-93c2-39afa48939f7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.717467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.718267 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.718550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.718824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] PATH_INFO: `/v3/projects/54582a46b8df4b74b56fb7abb29632f3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.720038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54582a46b8df4b74b56fb7abb29632f3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.722004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.770254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54582a46b8df4b74b56fb7abb29632f3', 'request_id': 'req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.775911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54582a46b8df4b74b56fb7abb29632f3', 'request_id': 'req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.783137 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54582a46b8df4b74b56fb7abb29632f3', 'request_id': 'req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.801366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] The token cache is being invalidate because project 54582a46b8df4b74b56fb7abb29632f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:38.801658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.802418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-49350454-d3ee-4eb0-aa8d-ce0a6599c1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.804046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1320/2621] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:38 2022] DELETE /identity/v3/projects/54582a46b8df4b74b56fb7abb29632f3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:38.811801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.812547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.812707 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.833864 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:38.835099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.898195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1302/2622] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:38.906136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.906423 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.906702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.925480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:38.926672 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.935048 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1321/2623] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:38.939377 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.949354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47d6a2-a48a-4965-b092-eced1b25dcd3 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.954386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.955039 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.955324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.955950 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.956686 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:38.956994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.958602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.975324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1303/2624] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:38.980038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.989603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af106-eb04-4c17-96c3-8b6eb72ec0f2 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.995171 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.995839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.996119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.996392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.997074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.999016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.009413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:39.031452 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1322/2625] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.035886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.046115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42043cf-8bab-4b38-9766-ca96a92a8bdc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.097431 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:39.106243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.107399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.107799 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.108109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.108916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.110922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.137286 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1304/2626] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.143549 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.155382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c191b30-9f95-40dd-a3a3-06d1ab5e611f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.161967 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.162661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.163108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.163603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.164767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.167379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.184131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1323/2627] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:39.188594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.203405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5cd05-fbbb-43c8-9b69-fd2c531230a5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.211506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.212433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.212722 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.212994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.214051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.216004 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6852d-b51b-4fca-9379-1aa2b3a5c7ea admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.226354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1305/2628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:39.230443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.240764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1bd5-6007-4aa8-93ef-f09c7ded6c1a admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.246295 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.247169 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.247479 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.247774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] PATH_INFO: `/v3/projects/d1f63a87e57e4d77a9cc6c47dd7d51b3/users/cfc9bca1146f4a18a1a5913111c25758/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.262614 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f63a87e57e4d77a9cc6c47dd7d51b3, user_id=cfc9bca1146f4a18a1a5913111c25758, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.265303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.280312 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1324/2629] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:39 2022] PUT /identity/v3/projects/d1f63a87e57e4d77a9cc6c47dd7d51b3/users/cfc9bca1146f4a18a1a5913111c25758/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:39.290511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.290803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.291187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.318389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] MFA Rules not processed for user `cfc9bca1146f4a18a1a5913111c25758`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.319638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.394468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1306/2630] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.399130 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.477468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a89ca-d7bd-45f9-9775-b19dadbf84dd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.482491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.483154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.483540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.483820 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.484520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.486416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.513196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1325/2631] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.517398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.528609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09fd58-de47-445e-8473-d647de56b06c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.586098 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.586775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.587060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.587369 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.588066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.590013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.610850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1307/2632] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.616299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.627859 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27893ea-5cbc-45fe-83a8-936c04258d00 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.633928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.634594 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.634879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.635155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.635926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.637617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.648669 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1326/2633] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:39.652739 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.662847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14f93-f971-4ab5-9ddd-5909fec101f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.667674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.668623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.668901 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.669170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] PATH_INFO: `/v3/projects/fccf96d615ee474ebde44ba3780655c8/users/a82ac48296994660b2a5183ce7143f3b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.684906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccf96d615ee474ebde44ba3780655c8, user_id=a82ac48296994660b2a5183ce7143f3b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.687612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.702119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1308/2634] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:39 2022] PUT /identity/v3/projects/fccf96d615ee474ebde44ba3780655c8/users/a82ac48296994660b2a5183ce7143f3b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:39.706604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.716638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738230-2d31-45ea-b115-0a91ac299a24 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.775688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.776294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.776575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.776887 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.777664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.779300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e0a1-850b-4c39-9940-7e0a1fb3fec7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.789164 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1327/2635] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:39.793850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.804914 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb4d0-ddbd-4276-bae9-b72e46150882 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.809823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.810705 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.810987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.811295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] PATH_INFO: `/v3/projects/fccf96d615ee474ebde44ba3780655c8/users/a82ac48296994660b2a5183ce7143f3b/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.813390 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccf96d615ee474ebde44ba3780655c8, user_id=a82ac48296994660b2a5183ce7143f3b, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.816086 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.826508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1309/2636] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:39 2022] PUT /identity/v3/projects/fccf96d615ee474ebde44ba3780655c8/users/a82ac48296994660b2a5183ce7143f3b/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:39.838046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.838342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.838626 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.865083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] MFA Rules not processed for user `a82ac48296994660b2a5183ce7143f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.866284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.878760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:39.933850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1328/2637] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.945778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.947744 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.969047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:40.008701 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68001d-d5fb-4841-a4a0-0b83ab3967df admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.012594 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.013221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.013504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.013772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.022904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.024639 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.034987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1310/2638] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:40.129819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.141678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca79e6-27d7-47a1-b6ae-e3e89fc49dad None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.148333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.149153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.149443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.149721 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.210985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.212475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6af52-75dc-4a76-85ed-8484c606ebe4 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.221764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1329/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:40.492486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.556204 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655402c-f477-4800-997c-6da41f35a215 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.562164 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.563060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.563397 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.563685 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] PATH_INFO: `/v3/users/cfc9bca1146f4a18a1a5913111c25758` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.564972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc9bca1146f4a18a1a5913111c25758)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.566969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.620443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc9bca1146f4a18a1a5913111c25758'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:40.627604 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc9bca1146f4a18a1a5913111c25758'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:40.636829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc9bca1146f4a18a1a5913111c25758'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:40.637487 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc9bca1146f4a18a1a5913111c25758'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:40.648892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc9bca1146f4a18a1a5913111c25758'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:40.654966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1311/2640] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:40 2022] DELETE /identity/v3/users/cfc9bca1146f4a18a1a5913111c25758 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:40.659586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.660082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.660212 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.678200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:40.679440 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:40.742828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1330/2641] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:40.753138 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.754778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:40.801631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:40.819371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369d7c9-2016-4449-9e33-eaf9445265d0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.823508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.824157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.824437 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.824749 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.834869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.836334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.846073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1312/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:41.135421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.137087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.152384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8361bc6-4313-4667-ae77-6b03557f5ab1 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.158202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.159127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.159438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.159678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] PATH_INFO: `/v3/projects/d1f63a87e57e4d77a9cc6c47dd7d51b3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.160952 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f63a87e57e4d77a9cc6c47dd7d51b3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.162900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.219649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:41.223462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f63a87e57e4d77a9cc6c47dd7d51b3', 'request_id': 'req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.233106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f63a87e57e4d77a9cc6c47dd7d51b3', 'request_id': 'req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.239496 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f63a87e57e4d77a9cc6c47dd7d51b3', 'request_id': 'req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.253364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] The token cache is being invalidate because project d1f63a87e57e4d77a9cc6c47dd7d51b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:41.253662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.254359 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.256388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1331/2643] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:41 2022] DELETE /identity/v3/projects/d1f63a87e57e4d77a9cc6c47dd7d51b3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:41.261319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.271601 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7fa1-05fd-4c7c-8360-f4058cb3dec3 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.331724 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.332513 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.332768 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.333052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] PATH_INFO: `/v3/users/a82ac48296994660b2a5183ce7143f3b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.334245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82ac48296994660b2a5183ce7143f3b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.336271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.385865 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82ac48296994660b2a5183ce7143f3b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.393007 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82ac48296994660b2a5183ce7143f3b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.401329 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82ac48296994660b2a5183ce7143f3b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.401992 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82ac48296994660b2a5183ce7143f3b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.418755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-3b609e48-dfb4-42e3-957d-92203ff773f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82ac48296994660b2a5183ce7143f3b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.429677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1313/2644] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:41 2022] DELETE /identity/v3/users/a82ac48296994660b2a5183ce7143f3b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:41.708888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.710498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.723828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebccbe-c943-476c-bcf2-40e0d74d6c81 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.782670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.783609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.783884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.784153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] PATH_INFO: `/v3/projects/fccf96d615ee474ebde44ba3780655c8` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.785451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccf96d615ee474ebde44ba3780655c8)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.787392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.837044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccf96d615ee474ebde44ba3780655c8', 'request_id': 'req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.842698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccf96d615ee474ebde44ba3780655c8', 'request_id': 'req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.848973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccf96d615ee474ebde44ba3780655c8', 'request_id': 'req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.863284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] The token cache is being invalidate because project fccf96d615ee474ebde44ba3780655c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:41.863598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.864244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-db7603fc-d15a-4ea6-8eeb-fbfc3288c785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.865850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1332/2645] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:41 2022] DELETE /identity/v3/projects/fccf96d615ee474ebde44ba3780655c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:41.870920 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.871421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.871519 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.889152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:41.890368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.944797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:41.955352 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1314/2646] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:41.963565 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.963857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.964139 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.984548 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:41.985796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.995682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1333/2647] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:42.000033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.010822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b4994-c5d0-451e-848d-3037e8013850 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.016856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.017508 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.017797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.018063 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.018793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:42.019103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.020803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.033061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1315/2648] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:42.037462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.046918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d6eb-8da8-4592-ad7e-ddf7cd2a8f6f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.052886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.053537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.053814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.054083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.054774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.056699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.085503 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1334/2649] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:42.089933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.100526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4f3d-cefa-46eb-ae0d-ffba87adb0bd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.161357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.162061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.162338 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.162611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.163365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.165564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.190175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1316/2650] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:42.194987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.211623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81264407-039d-40ab-b5d4-63e29ebbee75 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.217210 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.217864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.218145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.218419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.219141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.220863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.231734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1335/2651] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.235625 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.245572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218d84-9bd0-4f83-9d3f-2d791ce05673 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.250831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.251797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.252087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.252360 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.253083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.254669 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd538b-7375-4a3b-b2fb-7690ad784bb1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.265125 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1317/2652] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.269225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.279501 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5c45-0972-4928-9464-2b819f2d7fff admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.284649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.285622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.285865 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.286138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] PATH_INFO: `/v3/projects/d6b6d402abc849a2903c820c9e552742/users/eae698fddf794f00baeed3604e4acee8/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.301027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b6d402abc849a2903c820c9e552742, user_id=eae698fddf794f00baeed3604e4acee8, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.303691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.314900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:42.320099 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1336/2653] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:42 2022] PUT /identity/v3/projects/d6b6d402abc849a2903c820c9e552742/users/eae698fddf794f00baeed3604e4acee8/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:42.330245 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.330885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.331170 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.358786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] MFA Rules not processed for user `eae698fddf794f00baeed3604e4acee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:42.359924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.425565 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1318/2654] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:42.437069 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.439163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.504720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6df86-1ded-4c63-9ef3-2fb5617dd706 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.511250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.512050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.512332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.512605 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.521453 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.522881 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6d17-5f96-4b7d-95a6-643def2d1775 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.532038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1337/2655] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:42.551631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.624773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:42.631980 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587853-9e4c-4a5d-bb15-5656f640ed55 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.637274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.638182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.638458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.638728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] PATH_INFO: `/v3/users/eae698fddf794f00baeed3604e4acee8` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.640078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae698fddf794f00baeed3604e4acee8)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.642031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.689547 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae698fddf794f00baeed3604e4acee8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.696239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae698fddf794f00baeed3604e4acee8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.704897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae698fddf794f00baeed3604e4acee8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.705854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae698fddf794f00baeed3604e4acee8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.717832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae698fddf794f00baeed3604e4acee8'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.723617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1319/2656] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:42 2022] DELETE /identity/v3/users/eae698fddf794f00baeed3604e4acee8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:42.728288 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.728780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.728880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.747375 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:42.748584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.810196 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1338/2657] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:42.820047 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.821630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.881295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7720f8-518b-4112-b64a-93b9f65bfce6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.885832 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.886475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.886750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.887272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.896952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.898398 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9f95-e49a-4bc7-8f0a-6e160d0838b6 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.907767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1320/2658] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:43.186694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.188261 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.200963 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e402b5-9848-49f4-9f9d-405e9d893685 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.206105 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.207014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.207292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.207601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] PATH_INFO: `/v3/projects/d6b6d402abc849a2903c820c9e552742` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.208798 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b6d402abc849a2903c820c9e552742)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.210739 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.266664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b6d402abc849a2903c820c9e552742', 'request_id': 'req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:43.272753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b6d402abc849a2903c820c9e552742', 'request_id': 'req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:43.279304 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b6d402abc849a2903c820c9e552742', 'request_id': 'req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:43.292797 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] The token cache is being invalidate because project d6b6d402abc849a2903c820c9e552742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:43.293084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:43.293699 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b50184ba-2a91-4faa-9bdf-6e8a1ad843ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:43.295234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1339/2659] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:43 2022] DELETE /identity/v3/projects/d6b6d402abc849a2903c820c9e552742 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:43.300259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.300554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.300863 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.319085 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.320609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.383936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1321/2660] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:43.393134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.393418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.393686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.412351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.413550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.422586 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1340/2661] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:43.426904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.445333 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afea5b-e75d-4ba2-9bef-6551ae15412c None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.452615 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.453302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.453587 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.453856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.454596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:43.454902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.456869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.469406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1322/2662] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:43.474066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.484680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3688961-05ec-40c9-bcea-7b7e05512eef None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.490172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.490831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.491113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.491427 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.492134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.494041 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.515978 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:43.527987 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1341/2663] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:43.529135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.536184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:43.540246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212937e0-df48-4a9c-878f-0d48c2183cf5 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.600774 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.601439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.601723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.601995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.602710 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.604645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.625998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1323/2664] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:43.630259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.645563 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5beab6-0f47-42a3-b10a-583254b5c1c1 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.653009 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.653637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.653915 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.654187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.654912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.656551 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.667581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1342/2665] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:43.671526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.681753 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdf5b2-035c-4e11-81c9-79677aa2b873 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.686765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.687452 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.687735 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.688008 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.688738 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.690350 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b831f99-bd92-4575-8f77-221fec28b2eb admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.700285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1324/2666] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:43.704408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.715617 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a64a5-921e-42f3-bb1e-3150d07a938b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.721357 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.722257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.722543 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.722824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] PATH_INFO: `/v3/projects/c3b6044e9c2e44009b2e7f5ee43019ac/users/20d6e0c983e14de0a3d7d352d061b3ff/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.739652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b6044e9c2e44009b2e7f5ee43019ac, user_id=20d6e0c983e14de0a3d7d352d061b3ff, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.742350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.757285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1343/2667] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:43 2022] PUT /identity/v3/projects/c3b6044e9c2e44009b2e7f5ee43019ac/users/20d6e0c983e14de0a3d7d352d061b3ff/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:43.762583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2c4-3d37-4041-b9cf-d2d0cbe3679b None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.762875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2c4-3d37-4041-b9cf-d2d0cbe3679b None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.763153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2c4-3d37-4041-b9cf-d2d0cbe3679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.781380 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2331c2c4-3d37-4041-b9cf-d2d0cbe3679b None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.782585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2331c2c4-3d37-4041-b9cf-d2d0cbe3679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.844087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1325/2668] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:43.853925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.855853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.919524 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd4c7-922d-45ac-9f50-d09b2abcc384 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.923930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.924576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.924856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.925133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.938621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.940077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.949796 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1344/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:44.570244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b787d-9f4c-449f-bdc3-15aaafa9a9d6 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.570801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b787d-9f4c-449f-bdc3-15aaafa9a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.570801 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b787d-9f4c-449f-bdc3-15aaafa9a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.602439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-ed2b787d-9f4c-449f-bdc3-15aaafa9a9d6 None None] MFA Rules not processed for user `20d6e0c983e14de0a3d7d352d061b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:44.603856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-ed2b787d-9f4c-449f-bdc3-15aaafa9a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.689878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1326/2670] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:44.700664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.702345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.765937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572af61-e266-482f-94f1-a1c2fb0b0413 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.770017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.770658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.770935 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.771205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.779835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.781416 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.791248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1345/2671] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:46.149657 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.150095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.150195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.167915 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] MFA Rules not processed for user `20d6e0c983e14de0a3d7d352d061b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:46.169109 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:46.176046 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1327/2672] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:51.333552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:51.343562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffb14f-a052-432d-a914-5106fd052922 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:51.347470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:51.348177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:51.348546 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:51.348886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:51.350829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:51.363392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:51.364930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:51.374838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1346/2673] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:54.695215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:54.697280 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:54.712188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12819a-ce83-4eac-943d-d0d8f9a7ea88 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:54.716807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:54.717689 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:54.717968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:54.718240 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] PATH_INFO: `/v3/users/b191f41e53064acbaf17e3da073e7c85` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:54.719459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b191f41e53064acbaf17e3da073e7c85)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:54.721391 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:54.722993 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:54.767931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b191f41e53064acbaf17e3da073e7c85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:54.774922 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b191f41e53064acbaf17e3da073e7c85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:54.783703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b191f41e53064acbaf17e3da073e7c85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:54.784322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b191f41e53064acbaf17e3da073e7c85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:54.796807 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c2941a77-4b6a-4ef2-b5ad-a3dbb5fe2810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b191f41e53064acbaf17e3da073e7c85'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:54.802952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1328/2674] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:54 2022] DELETE /identity/v3/users/b191f41e53064acbaf17e3da073e7c85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:54.978649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:54.989064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682013c-c7d3-4ff1-8683-5178c00225a4 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.042800 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:55.050394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.051418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.051893 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.052338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] PATH_INFO: `/v3/projects/1d89deaaefc541739f67ab1e53c4bda3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.053754 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d89deaaefc541739f67ab1e53c4bda3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.055729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.117073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d89deaaefc541739f67ab1e53c4bda3', 'request_id': 'req-12e15f5d-2983-4889-a974-400f01d5a9ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:55.123044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d89deaaefc541739f67ab1e53c4bda3', 'request_id': 'req-12e15f5d-2983-4889-a974-400f01d5a9ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:55.129491 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d89deaaefc541739f67ab1e53c4bda3', 'request_id': 'req-12e15f5d-2983-4889-a974-400f01d5a9ae'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:55.143898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] The token cache is being invalidate because project 1d89deaaefc541739f67ab1e53c4bda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:55.144236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:55.145417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-12e15f5d-2983-4889-a974-400f01d5a9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:55.146515 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1347/2675] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:54 2022] DELETE /identity/v3/projects/1d89deaaefc541739f67ab1e53c4bda3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:55.151839 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.152081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.152345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.171382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:55.172599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:55.235399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1329/2676] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:55.243004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.243394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.243740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.263112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:55.264351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:55.274715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1348/2677] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:55.279003 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.288870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a622da-33d9-4f53-ba3f-cda2a95ed5e8 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.293613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.294276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.294564 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.294843 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.295642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:55.295953 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.297588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.310253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1330/2678] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:55.314833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.324608 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cb43-b905-4cca-99b8-1e55c08b6967 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.330460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.331173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.331492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.331764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.332463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.334399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.364250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1349/2679] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:55 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:55.365479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.375823 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4021c-70fa-493d-8a10-16308c90dbf4 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.433118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.433682 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.433964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.434228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.434912 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.436906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.446994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:55.462486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1331/2680] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:55 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:55.466769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.477786 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7bdd-cebd-4b0c-a3f7-8604e886bf81 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.483385 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.484072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.484354 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.484623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.485347 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.486954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.499291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1350/2681] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:55.504909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.517147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289f138-f469-4af6-a75b-a33f7e6c0564 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.523176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.523881 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.524166 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.524439 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.525177 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.526878 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318ebcf-92a8-468d-8d3d-e50aac7f6657 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.538750 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1332/2682] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:55.545243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.560163 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27cdd-cb4a-48ce-b6f9-bb3a977b8911 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.566227 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.567127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.567434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.567707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] PATH_INFO: `/v3/projects/f9d1fbb158dc4d63a7aeb04d115f7636/users/2754a81c57c249cfa1bc9f0eb08e4dac/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.584498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d1fbb158dc4d63a7aeb04d115f7636, user_id=2754a81c57c249cfa1bc9f0eb08e4dac, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.587221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.603712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1351/2683] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:55 2022] PUT /identity/v3/projects/f9d1fbb158dc4d63a7aeb04d115f7636/users/2754a81c57c249cfa1bc9f0eb08e4dac/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:55.608972 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220741f-84fc-4103-bcf8-66de7240f899 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.609266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220741f-84fc-4103-bcf8-66de7240f899 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.609548 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220741f-84fc-4103-bcf8-66de7240f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.626927 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b220741f-84fc-4103-bcf8-66de7240f899 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:55.628230 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b220741f-84fc-4103-bcf8-66de7240f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:55.693824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1333/2684] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:55.705530 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.708177 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:55.768470 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5247c-4010-4bef-a62f-28ab48e9d2c8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.772574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.773239 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.773520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.773784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.783850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:55.785264 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871387-0194-4d23-bccb-f540f086e701 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:55.794722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1352/2685] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:00.506107 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:00.506677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:00.506677 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:00.518535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e426ff-7af1-4d1c-8434-54af3b72d7a2 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:00.519020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e426ff-7af1-4d1c-8434-54af3b72d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:00.519321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e426ff-7af1-4d1c-8434-54af3b72d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:00.528238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] MFA Rules not processed for user `20d6e0c983e14de0a3d7d352d061b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:00.529378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:00.554219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-d5e426ff-7af1-4d1c-8434-54af3b72d7a2 None None] MFA Rules not processed for user `2754a81c57c249cfa1bc9f0eb08e4dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:00.555908 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d5e426ff-7af1-4d1c-8434-54af3b72d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:00.571228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:00.596925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1334/2686] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:00.640741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1353/2687] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:00.655563 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:00.656931 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:00.735228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3186ccc-5e62-4f39-9599-8cfbcdedcea2 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:00.741031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:00.741694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:00.741976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:00.742260 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:00.751542 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:00.753160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87916b-bb23-4789-93ef-18ab295b05f8 service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:00.762357 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1335/2688] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:02.240498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:02.240888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:02.240888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:02.263966 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] MFA Rules not processed for user `2754a81c57c249cfa1bc9f0eb08e4dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:02.265459 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:02.281245 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1354/2689] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:10.758185 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=93 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:12.261314 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=24 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:19.409385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.409910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.410012 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.429205 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:19.430449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:19.490702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1336/2690] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 23 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:19.513728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:19.515720 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:19.597925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7caa0-cac1-4804-8a9f-c78721cae7b9 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:19.605219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:19.605863 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.606145 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.606419 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.615855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:19.617366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5398a8-6a92-4790-9bf8-92194947e4ed service swift] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:19.625795 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1355/2691] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:47:28.984702 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.986270 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:29.060886 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b658fa6-c57d-46cd-bf9f-188c0d44c843 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:29.066728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:29.067501 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:29.067712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:29.067977 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:29.069762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:29.083321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:29.084967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:29.097929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1337/2692] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:29.622299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=32 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:34.153536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:34.154128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:34.154128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:34.172073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] MFA Rules not processed for user `40e26487f27e4a0c81cfbf3cbe229045`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:34.173265 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:34.180722 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1356/2693] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 23 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:34.194949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:34.207254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160493-0d40-4af6-89b2-a1e4cd5fdd52 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:34.213662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2660c54018042e5af8535a2b7b5e9af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:34.214299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:34.214579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:34.214852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:34.223813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:34.225409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:34.233966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1338/2694] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 23 13:47:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:47:36.179172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.180713 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.195765 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc461a-9c01-4b85-8f19-8c65801c183b None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.200434 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.201454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.201869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.202176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] PATH_INFO: `/v3/users/20d6e0c983e14de0a3d7d352d061b3ff` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.203745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d6e0c983e14de0a3d7d352d061b3ff)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.206064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.256828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d6e0c983e14de0a3d7d352d061b3ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.263932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d6e0c983e14de0a3d7d352d061b3ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.264610 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d6e0c983e14de0a3d7d352d061b3ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.273349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d6e0c983e14de0a3d7d352d061b3ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.274053 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-31dfa22c-9683-4ad8-860a-4898e19d5d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d6e0c983e14de0a3d7d352d061b3ff'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.291932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1357/2695] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:36 2022] DELETE /identity/v3/users/20d6e0c983e14de0a3d7d352d061b3ff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:36.470189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.480939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b383a-ab28-49d2-b3d2-55124255ef7c service swift] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.541081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.541962 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.542274 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.542551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] PATH_INFO: `/v3/projects/c3b6044e9c2e44009b2e7f5ee43019ac` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.543905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b6044e9c2e44009b2e7f5ee43019ac)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.545814 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.569937 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.595147 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'request_id': 'req-137176e8-ee8c-4400-8428-75c9dbd1d4a6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.603872 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'request_id': 'req-137176e8-ee8c-4400-8428-75c9dbd1d4a6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.609507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'request_id': 'req-137176e8-ee8c-4400-8428-75c9dbd1d4a6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.620141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] The token cache is being invalidate because project c3b6044e9c2e44009b2e7f5ee43019ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:36.620422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.621029 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-137176e8-ee8c-4400-8428-75c9dbd1d4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.622609 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1339/2696] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:36 2022] DELETE /identity/v3/projects/c3b6044e9c2e44009b2e7f5ee43019ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:36.627591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.627884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.628149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.646955 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:36.648138 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.711068 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1358/2697] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:36.719031 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.719317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.719622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.739032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:36.740272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.749317 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1340/2698] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:36.753588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.763848 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056a82-1a19-4a4a-ae91-67fd4da61fc5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.769311 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.769997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.770309 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.770591 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.771350 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:36.771671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.773284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.785510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1359/2699] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:36.789792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.799266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e945f-6e3c-440e-88c7-1a9e81423927 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.805155 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.805810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.806092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.806361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.807058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.809087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.838703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1341/2700] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:36.843111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.853086 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afde97-4108-4ad8-aaa1-6e755d9d3838 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.899451 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.909233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.909905 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.910192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.910475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.911200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.913772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.934773 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1360/2701] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:36.938952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.949629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f1db6-b25d-40e8-b5d4-4254ec7a4d33 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.955741 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.956403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.956687 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.956960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.957688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.959301 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.970596 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1342/2702] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:36.974278 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.985925 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439612e-1f5d-42fc-8d45-913fa28535d4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.991228 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.991911 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.992192 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.992463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.993188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.994776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90c411-d23f-492b-914b-e40514e3b90f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.005183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1361/2703] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:37.009455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.020409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5615c8-8542-4401-bbfa-ba0852b0af39 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.025999 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.026891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.027173 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.027483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] PATH_INFO: `/v3/projects/1453e1a565d64c74a9f29ff4ba7b3c69/users/74585af733184fe9861923e53755b9f3/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.042510 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1453e1a565d64c74a9f29ff4ba7b3c69, user_id=74585af733184fe9861923e53755b9f3, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.045228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.060228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1343/2704] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:37 2022] PUT /identity/v3/projects/1453e1a565d64c74a9f29ff4ba7b3c69/users/74585af733184fe9861923e53755b9f3/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:37.071107 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.071500 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.071829 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.100307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] MFA Rules not processed for user `74585af733184fe9861923e53755b9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:37.101511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.168038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1362/2705] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:37.179925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.181974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.263458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae2d0-8374-4e2f-b2a6-d030bc2dfa96 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.267760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332b8759a3e8491a8a1319ce68e1d62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.268403 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.268681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.268959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.277728 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.279180 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600759f-b66f-440e-89f6-1d5092c8765f service glance] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.288081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1344/2706] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:47.164984 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:47.284299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=77,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:54.374856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:54.376433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:54.436510 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47449ee2-08d5-4518-a577-66ac32ddf17e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:54.440827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:54.441464 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:54.441743 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:54.442036 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:54.444012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:54.503263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:54.504729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:54.513904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1363/2707] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:03.510306 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740a84-7830-4a10-b130-434801232e38 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:03.510970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740a84-7830-4a10-b130-434801232e38 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:03.510970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740a84-7830-4a10-b130-434801232e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:03.529362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-bb740a84-7830-4a10-b130-434801232e38 None None] MFA Rules not processed for user `0a9f85caf65f431c96f27a7d04734211`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:03.530637 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bb740a84-7830-4a10-b130-434801232e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:03.538882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1345/2708] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:04.509512 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=48 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:12.913630 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:12.978823 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2bf9-a7a5-4eee-aae7-78d57659ebf1 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:12.985185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:12.986220 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:12.986505 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:12.986778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] PATH_INFO: `/v3/users/74585af733184fe9861923e53755b9f3` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:12.988200 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74585af733184fe9861923e53755b9f3)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:12.990254 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:13.041725 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74585af733184fe9861923e53755b9f3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.049208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74585af733184fe9861923e53755b9f3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.049922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74585af733184fe9861923e53755b9f3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.058690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74585af733184fe9861923e53755b9f3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.059437 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74585af733184fe9861923e53755b9f3'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.077753 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1364/2709] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:12 2022] DELETE /identity/v3/users/74585af733184fe9861923e53755b9f3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:13.082689 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:13.083162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:13.083279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:13.100923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:13.102163 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:13.162175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1346/2710] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:13.172115 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:13.173676 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:13.236821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624214fb-1e71-4a3d-8da7-51f9c3e53502 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:13.241662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:13.242351 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:13.242622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:13.242895 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:13.252511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:13.253969 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83f0a0-c5a8-436b-a9d9-68a7c4c8fcda service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:13.263308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1365/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:13.809505 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:13.811129 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:13.824121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168afebd-f7c4-41ed-b088-85617fe1c945 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:13.829479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:13.830388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:13.830665 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:13.830928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] PATH_INFO: `/v3/projects/1453e1a565d64c74a9f29ff4ba7b3c69` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:13.832242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1453e1a565d64c74a9f29ff4ba7b3c69)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:13.834288 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:13.882613 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1453e1a565d64c74a9f29ff4ba7b3c69', 'request_id': 'req-43a4d4d7-c587-43f4-801b-4a794fee54d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.890462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1453e1a565d64c74a9f29ff4ba7b3c69', 'request_id': 'req-43a4d4d7-c587-43f4-801b-4a794fee54d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.896492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1453e1a565d64c74a9f29ff4ba7b3c69', 'request_id': 'req-43a4d4d7-c587-43f4-801b-4a794fee54d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.908167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] The token cache is being invalidate because project 1453e1a565d64c74a9f29ff4ba7b3c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:13.908458 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.909247 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-43a4d4d7-c587-43f4-801b-4a794fee54d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:13.911022 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1347/2712] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:13 2022] DELETE /identity/v3/projects/1453e1a565d64c74a9f29ff4ba7b3c69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:13.916155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:13.916670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:13.916775 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:13.937104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:13.938307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:13.956767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:14.003011 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1366/2713] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:14.012777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.013157 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.013536 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.034969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:14.036386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:14.045973 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1348/2714] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:14.050544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.061166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc46247-c965-4c6e-912a-d793bc75ac7f None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.066871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.067597 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.067876 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.068146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.068872 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:14.069183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.070838 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.083734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1367/2715] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:14.088482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.100243 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebde59-c55d-48db-bb7f-38f56a3a42c7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.107080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.107824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.108103 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.108372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.109095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.111315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.142065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1349/2716] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:14 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:14.146535 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.157763 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f187e-23f0-43ad-bee1-f3d92ea4fb5b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.217186 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.217771 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.218046 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.218317 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.219004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.221012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.242315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1368/2717] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:14 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:14.246806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.258285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e4f93-d586-4093-bce5-9ffc19e9b2fe admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.263848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.264512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.264882 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.265162 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.265899 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.267572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.278771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1350/2718] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:14.283066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.293648 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167688-1234-4218-8dec-64f46983fceb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.299489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.300176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.300458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.300734 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.301475 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.303148 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0f73-2aca-43ff-a49c-549254e8bf80 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.314410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1369/2719] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:14.318782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.329455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193175-ea83-42c4-b28a-63db7c1d0376 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.334605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.335584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.335855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.336132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] PATH_INFO: `/v3/projects/c10a291e268f49069835b7bb81e5a8c2/users/0e646f42154c4547bf6d490ec6c45f1a/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.351200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10a291e268f49069835b7bb81e5a8c2, user_id=0e646f42154c4547bf6d490ec6c45f1a, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.353905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.368983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1351/2720] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:14 2022] PUT /identity/v3/projects/c10a291e268f49069835b7bb81e5a8c2/users/0e646f42154c4547bf6d490ec6c45f1a/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:14.381140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.381432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.381712 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.409380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] MFA Rules not processed for user `0e646f42154c4547bf6d490ec6c45f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:14.410593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:14.487609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1370/2721] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:14.499221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:14.501196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:14.516528 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:14.561607 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ccad-680a-4821-b097-775e1b52fa54 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:14.565835 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:14.566494 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:14.566784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:14.567053 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:14.575662 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:14.577124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae571-c467-4f40-a62a-e3717c7ea3d8 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:14.588322 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1352/2722] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:24.483489 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:24.582776 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=20 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:33.005291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.070509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362da84f-acd4-4eae-84fe-c6ed34c45462 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.075141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.076100 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.076483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.076745 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] PATH_INFO: `/v3/users/0e646f42154c4547bf6d490ec6c45f1a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.077944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e646f42154c4547bf6d490ec6c45f1a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.080371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.134937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e646f42154c4547bf6d490ec6c45f1a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.142681 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e646f42154c4547bf6d490ec6c45f1a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.143443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e646f42154c4547bf6d490ec6c45f1a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.152572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e646f42154c4547bf6d490ec6c45f1a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.153234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e646f42154c4547bf6d490ec6c45f1a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.171223 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1371/2723] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:33 2022] DELETE /identity/v3/users/0e646f42154c4547bf6d490ec6c45f1a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:33.175824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.176321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.176428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.193124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:33.194323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.254948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1353/2724] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:33.266072 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.267717 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.327891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b36-2660-4cd8-ab6f-13b97c1ba200 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.332817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.333947 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.334457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.334778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.344547 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.345988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3897d1-ed6f-4348-9991-a0be15e2f4cc service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.359066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1372/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:33.652837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.654551 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.668897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576a99-14d9-45ab-b54a-6008124ab0d5 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.673683 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.674575 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.674851 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.675123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] PATH_INFO: `/v3/projects/c10a291e268f49069835b7bb81e5a8c2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.676545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10a291e268f49069835b7bb81e5a8c2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.678475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.734588 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10a291e268f49069835b7bb81e5a8c2', 'request_id': 'req-4c4a5482-ca98-455d-940f-c076a03f3235'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.743379 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10a291e268f49069835b7bb81e5a8c2', 'request_id': 'req-4c4a5482-ca98-455d-940f-c076a03f3235'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.749887 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10a291e268f49069835b7bb81e5a8c2', 'request_id': 'req-4c4a5482-ca98-455d-940f-c076a03f3235'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.762169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] The token cache is being invalidate because project c10a291e268f49069835b7bb81e5a8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:33.762401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.763137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4c4a5482-ca98-455d-940f-c076a03f3235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.764777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1354/2726] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:33 2022] DELETE /identity/v3/projects/c10a291e268f49069835b7bb81e5a8c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:33.770705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.771094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.771480 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.790290 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:33.791483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.809415 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:33.857207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1373/2727] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:33.865189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.865486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.865747 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.885188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:33.886438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.895032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1355/2728] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:33.899488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.909456 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afaa92-7c0e-43cb-903b-b9b408b01145 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.914724 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.915376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.915693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.915988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.916700 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:33.917010 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.918623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.930509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1374/2729] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:33.934871 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.944718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6fa41-5977-4474-93cb-355ee60c55bb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.950255 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.950911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.951165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.951472 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.952176 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.954477 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.990310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1356/2730] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/projects => generated 395 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:33.995023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.006090 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088087d-508d-4544-b532-0b083d44f77d admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.066438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.067032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.067315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.067623 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.068307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.070287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.090920 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1375/2731] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:34.095200 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.106524 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686605-d30b-4a37-9047-04caa2b89c2b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.111395 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.112065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.112351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.112630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.113378 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.115035 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.126646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1357/2732] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:34.130885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.141364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812b7a-7d85-45db-9e38-63f700708242 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.146191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.146845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.147128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.147465 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.148263 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.149857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e25a6-b8eb-4ba6-80bf-9fc282075eb9 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.159975 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1376/2733] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:34.164302 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.174743 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681954b-ead7-4ca2-af0e-596defc167f0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.179929 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.180793 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.181075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.181363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] PATH_INFO: `/v3/projects/acc16820b5084f29aec91b7e564744cc/users/fcf1e5c7bd644ac6ad6c894d49c20946/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.196642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc16820b5084f29aec91b7e564744cc, user_id=fcf1e5c7bd644ac6ad6c894d49c20946, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.199330 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.214077 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1358/2734] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:34 2022] PUT /identity/v3/projects/acc16820b5084f29aec91b7e564744cc/users/fcf1e5c7bd644ac6ad6c894d49c20946/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:34.224462 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.224761 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.225044 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.255250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] MFA Rules not processed for user `fcf1e5c7bd644ac6ad6c894d49c20946`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:34.256657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.332049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1377/2735] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:34.343672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.345496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.368620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:34.407629 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998837b-33ca-48c9-a473-8f4854d88e1d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.411640 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.412358 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.412645 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.412919 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.421584 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.423066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beea863-c78a-4800-9de7-b61071580249 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.432141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1359/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:42.565723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.591853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:42.639504 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553bb07-02fe-4d77-9304-b94cfb042514 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:42.645133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:42.646061 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.646338 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.646615 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] PATH_INFO: `/v3/users/fcf1e5c7bd644ac6ad6c894d49c20946` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.648040 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf1e5c7bd644ac6ad6c894d49c20946)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:42.649971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:42.699185 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf1e5c7bd644ac6ad6c894d49c20946'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.706274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf1e5c7bd644ac6ad6c894d49c20946'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.706942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf1e5c7bd644ac6ad6c894d49c20946'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.714937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf1e5c7bd644ac6ad6c894d49c20946'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.715606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf1e5c7bd644ac6ad6c894d49c20946'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.733912 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1378/2737] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:42 2022] DELETE /identity/v3/users/fcf1e5c7bd644ac6ad6c894d49c20946 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:42.738606 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.739139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.739139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.759028 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:42.760261 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:42.825641 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1360/2738] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:42.835833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.837332 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:42.894302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabddf8b-6e78-4ea6-b5e9-213c706848b2 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:42.898275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:42.899081 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.899366 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.899662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.909071 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:42.910469 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:42.920112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1379/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:43.202576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.204474 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.217167 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea49846-6da4-4aae-8c04-8d8ac561f0ac None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.222620 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.223541 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.223824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.224083 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] PATH_INFO: `/v3/projects/acc16820b5084f29aec91b7e564744cc` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.225558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc16820b5084f29aec91b7e564744cc)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.227589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.279366 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc16820b5084f29aec91b7e564744cc', 'request_id': 'req-148c34a7-daee-44ea-8174-04777188ae87'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.288076 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc16820b5084f29aec91b7e564744cc', 'request_id': 'req-148c34a7-daee-44ea-8174-04777188ae87'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.293363 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc16820b5084f29aec91b7e564744cc', 'request_id': 'req-148c34a7-daee-44ea-8174-04777188ae87'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.304667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] The token cache is being invalidate because project acc16820b5084f29aec91b7e564744cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:43.304974 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.305633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.307195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1361/2740] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:43 2022] DELETE /identity/v3/projects/acc16820b5084f29aec91b7e564744cc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:52.916156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:53.301761 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:15.727217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.736613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f85b-340e-430f-a3ea-45f9586796bb service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.797439 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.798016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.798297 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.798572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.800661 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:15.879919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.881367 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.892454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1380/2741] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:17.081000 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:17.082523 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:17.097214 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c34a7-daee-44ea-8174-04777188ae87 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:17.102580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:17.103268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:17.103580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:17.103875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:17.105891 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:17.120956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:17.122481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338f20-1812-42ec-ae2d-ca59ffa87d18 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:17.134043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1362/2742] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:25.887767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=54 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:27.128956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=6 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:57.738216 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:57.739980 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:57.753843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8fa36-f7a5-4f11-9589-0c3b243fb66e service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:57.760460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:57.761121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:57.761405 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:57.761678 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:57.763696 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:57.781083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:57.783221 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:57.796396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1381/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:00.157024 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:00.157602 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:00.157723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:00.177196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] MFA Rules not processed for user `2754a81c57c249cfa1bc9f0eb08e4dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:00.178388 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:00.242874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1363/2744] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:00.558965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:00.568913 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c10d8d-d62b-4bbb-b66b-b85699fd9f81 service nova] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:00.573398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:00.574033 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:00.574310 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:00.574578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:00.576707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:00.586698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:00.588155 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:00.596205 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1382/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:00.942959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:00.944500 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:01.016195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de896-6b32-4ff9-a290-edbea6af19cb None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:01.021423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:01.022082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:01.022435 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:01.022716 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:01.025114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:01.037327 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:01.038942 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:01.048926 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1364/2746] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:02.681760 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:02.683322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:02.694237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3007a6d-d66d-405d-88f2-4e11dcb4ca0f service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:02.697888 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:02.698536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:02.698814 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:02.699083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:02.702706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:02.713601 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:02.715074 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:02.724564 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1383/2747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:09.214964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:09.228386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62ccd7-17af-4874-8a4d-5f49a9c58f24 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:09.235277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:09.236069 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:09.236496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:09.236780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:09.238822 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:09.252361 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:09.254187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:09.265964 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1365/2748] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:12.720039 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=18 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:19.261102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=63 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:22.702321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:22.711467 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b519c-39bc-404a-a1e5-262677bcc8d1 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:22.715208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:22.715870 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:22.716151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:22.716421 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:22.718268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:22.785049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:22.786492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:22.796233 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1384/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:28.853709 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.855861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:28.871488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf3a7-fbee-4896-beec-6fd3fb9dab4f service nova] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.876345 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.877234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.877516 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.877791 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] PATH_INFO: `/v3/users/0a9f85caf65f431c96f27a7d04734211` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.878998 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9f85caf65f431c96f27a7d04734211)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.880995 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.929970 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9f85caf65f431c96f27a7d04734211'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:28.936597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9f85caf65f431c96f27a7d04734211'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:28.945401 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9f85caf65f431c96f27a7d04734211'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:28.946090 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9f85caf65f431c96f27a7d04734211'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:28.958770 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9f85caf65f431c96f27a7d04734211'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:28.964844 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1366/2750] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:28 2022] DELETE /identity/v3/users/0a9f85caf65f431c96f27a7d04734211 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:29.137997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:29.148408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20a98a-7fd0-43d3-b355-a804dee1850d service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:29.211498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:29.212373 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:29.212652 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:29.212919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] PATH_INFO: `/v3/projects/0d6c438e59834c4084c818053e1fdb93` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:29.214240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6c438e59834c4084c818053e1fdb93)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:29.216160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:29.262147 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6c438e59834c4084c818053e1fdb93', 'request_id': 'req-2de076df-e6e0-4486-be38-d9fea11d5561'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.267490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6c438e59834c4084c818053e1fdb93', 'request_id': 'req-2de076df-e6e0-4486-be38-d9fea11d5561'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.273408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6c438e59834c4084c818053e1fdb93', 'request_id': 'req-2de076df-e6e0-4486-be38-d9fea11d5561'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.289562 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] The token cache is being invalidate because project 0d6c438e59834c4084c818053e1fdb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:29.289942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.290885 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.293398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1385/2751] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:29 2022] DELETE /identity/v3/projects/0d6c438e59834c4084c818053e1fdb93 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:29.298884 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:29.300419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:29.317900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3a15-8f97-49a6-b635-c39a9204217f admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:29.376989 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:29.377870 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:29.378151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:29.378412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] PATH_INFO: `/v3/users/1896bdbe02374c2583aff5b5cd4cad3a` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:29.379663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1896bdbe02374c2583aff5b5cd4cad3a)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:29.381595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:29.437667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1896bdbe02374c2583aff5b5cd4cad3a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.444630 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1896bdbe02374c2583aff5b5cd4cad3a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.453941 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1896bdbe02374c2583aff5b5cd4cad3a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.454789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1896bdbe02374c2583aff5b5cd4cad3a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.464152 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:29.469030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1896bdbe02374c2583aff5b5cd4cad3a'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.475829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1367/2752] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:29 2022] DELETE /identity/v3/users/1896bdbe02374c2583aff5b5cd4cad3a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:29.658131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:29.659774 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:29.673518 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de076df-e6e0-4486-be38-d9fea11d5561 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:29.697047 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:29.739079 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:29.739995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:29.740299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:29.740573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] PATH_INFO: `/v3/projects/2b79d3fc84d14047869621c77ca0c2bb` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:29.741821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b79d3fc84d14047869621c77ca0c2bb)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:29.743779 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:29.791391 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b79d3fc84d14047869621c77ca0c2bb', 'request_id': 'req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.797698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b79d3fc84d14047869621c77ca0c2bb', 'request_id': 'req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.804482 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b79d3fc84d14047869621c77ca0c2bb', 'request_id': 'req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.818402 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] The token cache is being invalidate because project 2b79d3fc84d14047869621c77ca0c2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:29.818690 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.819328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:29.820929 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1386/2753] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:29 2022] DELETE /identity/v3/projects/2b79d3fc84d14047869621c77ca0c2bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:39.476737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:39.815645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:20.189714 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.191186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.287088 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bb3d-4cb1-4c65-81c6-9a8ade45e809 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.291744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.293243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.358116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.358792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.359092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.359421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.361238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.370599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaceb-582e-4f15-8b84-c19b1fb0063c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.372406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.373994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.375258 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.376253 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.376533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.376806 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] PATH_INFO: `/v3/users/2754a81c57c249cfa1bc9f0eb08e4dac` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.378028 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2754a81c57c249cfa1bc9f0eb08e4dac)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.380014 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.384080 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1368/2754] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:20.427322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2754a81c57c249cfa1bc9f0eb08e4dac'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.434225 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2754a81c57c249cfa1bc9f0eb08e4dac'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.434880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2754a81c57c249cfa1bc9f0eb08e4dac'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.443194 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2754a81c57c249cfa1bc9f0eb08e4dac'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.443853 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-124e81ed-78ae-4b5a-802e-69176b9980a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2754a81c57c249cfa1bc9f0eb08e4dac'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.461134 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1387/2755] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:20 2022] DELETE /identity/v3/users/2754a81c57c249cfa1bc9f0eb08e4dac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:51:20.633780 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.647846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be326a-6af9-4280-91af-69bcfd830e41 service placement] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.702983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.703875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.704151 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.704421 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] PATH_INFO: `/v3/projects/f9d1fbb158dc4d63a7aeb04d115f7636` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.705624 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d1fbb158dc4d63a7aeb04d115f7636)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.707904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.746502 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:20.756684 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'request_id': 'req-822c0185-247d-432e-b00f-d7b5cc57aaf4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.764757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'request_id': 'req-822c0185-247d-432e-b00f-d7b5cc57aaf4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.770283 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'request_id': 'req-822c0185-247d-432e-b00f-d7b5cc57aaf4'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.780875 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] The token cache is being invalidate because project f9d1fbb158dc4d63a7aeb04d115f7636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:20.781195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.781847 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-822c0185-247d-432e-b00f-d7b5cc57aaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:20.783432 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1369/2756] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:20 2022] DELETE /identity/v3/projects/f9d1fbb158dc4d63a7aeb04d115f7636 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:20.788592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.788954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.789266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.808684 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:20.809928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.870511 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1388/2757] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:20.879199 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.879527 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.879805 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.899234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:20.900454 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.909723 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1370/2758] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:20.913982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.924182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9bec0-574c-4aba-9923-054763a0ec0e None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.929649 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.930302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.930573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.930849 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.931613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:20.931924 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.933531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.945424 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1389/2759] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:20.949681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.959465 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d747b4-4f53-43cf-86cf-a331b6ba5855 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.964468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.965110 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.965392 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.965664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.966355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.968296 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.004971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1371/2760] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:21.009294 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:21.019904 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4217-4841-4ec9-9d76-672d50516d19 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:21.023852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:21.100154 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:21.100821 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.101101 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.101374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.102064 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:21.104152 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.127711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1390/2761] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:21 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:51:21.131965 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:21.142820 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea33a-07b0-436c-90d7-0d0c3cc078bd admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:21.148073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:21.148729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.149009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.149282 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.150011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:21.151655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.162718 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1372/2762] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:21.166219 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:21.176607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e37f-2f2d-4cd4-b992-f6d6abb87549 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:21.181693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:21.182376 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.182654 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.182926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.183706 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:21.185324 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca7f64-0826-488c-ae95-ba59c582d1cb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.195531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1391/2763] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:21.199576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:21.210293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8f9f-9009-431f-bae1-ffe49243012d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:21.215880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:21.216762 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.217043 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.217307 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] PATH_INFO: `/v3/projects/5c24eb08d898421aa4e75fc3399cc3a7/users/e6bdbf9a5d71400bb02f3a7a7eca2762/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.234019 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c24eb08d898421aa4e75fc3399cc3a7, user_id=e6bdbf9a5d71400bb02f3a7a7eca2762, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:21.236784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.253114 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1373/2764] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:21 2022] PUT /identity/v3/projects/5c24eb08d898421aa4e75fc3399cc3a7/users/e6bdbf9a5d71400bb02f3a7a7eca2762/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:21.263291 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.263576 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.263855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.293016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] MFA Rules not processed for user `e6bdbf9a5d71400bb02f3a7a7eca2762`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:21.294206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:21.361533 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1392/2765] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:51:21.372778 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:21.374488 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:21.449259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb7cbd-0b48-4d89-abbc-15510ace47d7 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:21.455426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db1031b48c8142508bd94fe89142a9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:21.456049 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:21.456323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:21.456916 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:21.464813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:21.466399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38b7d-42c2-49cd-93c4-88c3c202224b service nova] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:21.475485 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1374/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:24.193302 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.257982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf617f-53ab-4055-8a98-3d58c48d1de3 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.263688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.264572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.264857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.265128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] PATH_INFO: `/v3/users/e6bdbf9a5d71400bb02f3a7a7eca2762` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.266458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bdbf9a5d71400bb02f3a7a7eca2762)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.268425 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.284657 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:24.317380 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bdbf9a5d71400bb02f3a7a7eca2762'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.324550 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bdbf9a5d71400bb02f3a7a7eca2762'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.325240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bdbf9a5d71400bb02f3a7a7eca2762'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.334443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bdbf9a5d71400bb02f3a7a7eca2762'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.335118 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bdbf9a5d71400bb02f3a7a7eca2762'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.353772 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1393/2767] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:24 2022] DELETE /identity/v3/users/e6bdbf9a5d71400bb02f3a7a7eca2762 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:24.359239 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.359951 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.360545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.384455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:24.385674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.429475 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:24.450788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1375/2768] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:24.461318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.463030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.524142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3ffb4-92f9-45ea-b93f-5f8d329657c8 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.528283 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.528931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.529211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.529509 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.538874 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.540340 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e703ef-0755-496a-bffa-08fdaf6a9635 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.550058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1394/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:24.831160 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.832907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.845422 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d423f-f060-4139-b5e3-bfc3539d2bce None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.850189 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.851071 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.851355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.851996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] PATH_INFO: `/v3/projects/5c24eb08d898421aa4e75fc3399cc3a7` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.853265 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c24eb08d898421aa4e75fc3399cc3a7)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.856225 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.904969 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c24eb08d898421aa4e75fc3399cc3a7', 'request_id': 'req-93d84271-2a93-470d-8f04-623616ba0c69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.913221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c24eb08d898421aa4e75fc3399cc3a7', 'request_id': 'req-93d84271-2a93-470d-8f04-623616ba0c69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.919586 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c24eb08d898421aa4e75fc3399cc3a7', 'request_id': 'req-93d84271-2a93-470d-8f04-623616ba0c69'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.930821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] The token cache is being invalidate because project 5c24eb08d898421aa4e75fc3399cc3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:24.931106 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.931757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-93d84271-2a93-470d-8f04-623616ba0c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.933371 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1376/2770] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:24 2022] DELETE /identity/v3/projects/5c24eb08d898421aa4e75fc3399cc3a7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:24.938588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.938869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.939178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.957783 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:24.959002 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.031809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1395/2771] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:25.039850 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.040139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.040415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.059712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:25.061250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.071481 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1377/2772] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:25.076023 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.086834 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b353832-d11e-4b73-b770-aa924e9a93dd None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.092766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.093430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.093746 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.094020 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.094778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:25.095084 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.096735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.110213 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1396/2773] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:25.114504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.124567 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104335-3696-4177-8277-3d48eb9985c9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.130269 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.131102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.131430 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.131779 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.132654 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.134632 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.163293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1378/2774] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:25.167289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.177536 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1ab5-a475-4a98-8d4e-a0d2048be6d7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.198807 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:25.236864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.237532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.237812 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.238111 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.238793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.240741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.260988 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1397/2775] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:25.265119 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.275631 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb85c-c485-4de0-b175-13c1a4ae1b32 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.281462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.282123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.282402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.282672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.283402 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.285030 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.295903 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1379/2776] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:25.299907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.310430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7267f0-0957-4952-bf4f-481050c982ab admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.316492 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.317151 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.317436 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.317711 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.318567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.320208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d951-1732-48eb-be04-3036612d6a6c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.330898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1398/2777] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:25.335617 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.346792 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b21f-93b8-4097-9a96-8700e1df3cf6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.352595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.353484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.353766 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.354034 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] PATH_INFO: `/v3/projects/409a9bc4cc0a4d1692dc17ccef77376d/users/32152ea524ce48f39b29634917f41c24/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.370141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409a9bc4cc0a4d1692dc17ccef77376d, user_id=32152ea524ce48f39b29634917f41c24, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.372821 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.389394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1380/2778] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:25 2022] PUT /identity/v3/projects/409a9bc4cc0a4d1692dc17ccef77376d/users/32152ea524ce48f39b29634917f41c24/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:25.400986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.401274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.401552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.428432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] MFA Rules not processed for user `32152ea524ce48f39b29634917f41c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:25.429580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.496173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1399/2779] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:25.500767 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.563732 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20e9de-efbe-4519-bdca-ccca4fe6b9f1 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.569060 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.569703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.569984 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.570253 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.570933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.572856 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.581101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:25.604356 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1381/2780] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:25.608430 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.619144 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6f593-e45b-4733-a04f-4aadca48b0ba None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.679448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.679693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.680018 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.680315 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.681016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.682931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.705472 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1400/2781] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:25.710141 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.721756 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613356b-2cf9-47c3-b776-b55af2584307 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.727212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.728025 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.728308 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.728611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.729342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.730983 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.742113 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1382/2782] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:25.746248 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.756285 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e048-f8b5-4695-b0aa-0bb589098fbb admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.761108 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.762001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.762308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.762584 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] PATH_INFO: `/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8/users/029035711359411a888374e0dcd53e8c/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.777540 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df2b88cada0467cb4ed1ef30d8523f8, user_id=029035711359411a888374e0dcd53e8c, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.780211 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.789839 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:25.796133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1401/2783] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:25 2022] PUT /identity/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8/users/029035711359411a888374e0dcd53e8c/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:51:25.800116 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.810145 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81610b0-4f92-40e0-82fd-abe99cbbd663 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.877344 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.878006 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.878276 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.878552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.879271 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.880907 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74b122-05c6-433a-bcda-4f8bf1489289 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.890961 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1383/2784] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:25.895259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.906559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ef68-cc92-42dc-8460-fd822f3df08c admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.912559 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.913455 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.913729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.914004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] PATH_INFO: `/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8/users/029035711359411a888374e0dcd53e8c/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.916244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df2b88cada0467cb4ed1ef30d8523f8, user_id=029035711359411a888374e0dcd53e8c, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.918918 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.930128 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1402/2785] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:25 2022] PUT /identity/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8/users/029035711359411a888374e0dcd53e8c/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:25.940217 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.940506 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.940788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.967890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] MFA Rules not processed for user `029035711359411a888374e0dcd53e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:25.969093 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.037834 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1384/2786] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:26.049803 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.051702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.113828 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2624ca-0d65-4169-91a4-9adbc4905e46 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:26.118017 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:26.118650 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.118934 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.119208 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.128833 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:26.130270 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7e352-119c-4f81-8285-9874f82033cc service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:26.139852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1403/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:26.202558 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.268773 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb93f6-9739-4224-978f-916acedc0ff9 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:26.273810 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:26.274680 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.274958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.275228 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] PATH_INFO: `/v3/users/32152ea524ce48f39b29634917f41c24` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.276482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=32152ea524ce48f39b29634917f41c24)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:26.278404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:26.279905 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:26.331246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32152ea524ce48f39b29634917f41c24'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.338849 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32152ea524ce48f39b29634917f41c24'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.346346 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32152ea524ce48f39b29634917f41c24'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.347066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32152ea524ce48f39b29634917f41c24'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.358911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32152ea524ce48f39b29634917f41c24'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.364939 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1385/2788] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:26 2022] DELETE /identity/v3/users/32152ea524ce48f39b29634917f41c24 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:26.369558 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.370049 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.370166 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.388257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:26.389450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.459539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1404/2789] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:26.471279 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.472711 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.534664 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7fab-dbd8-482d-9812-18f2d76f19fa admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:26.538848 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:26.539539 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.539826 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.540100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.549859 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:26.551311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:26.560782 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1386/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:26.833930 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.835398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.848534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3c33-bef4-4c51-8597-09d67d54510a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:26.853891 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:26.854789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.855060 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.855353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] PATH_INFO: `/v3/projects/409a9bc4cc0a4d1692dc17ccef77376d` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.856577 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=409a9bc4cc0a4d1692dc17ccef77376d)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:26.858495 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:26.906926 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409a9bc4cc0a4d1692dc17ccef77376d', 'request_id': 'req-baec8699-013e-48cd-b924-92e1c4b9a5dd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.912476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409a9bc4cc0a4d1692dc17ccef77376d', 'request_id': 'req-baec8699-013e-48cd-b924-92e1c4b9a5dd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.918599 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409a9bc4cc0a4d1692dc17ccef77376d', 'request_id': 'req-baec8699-013e-48cd-b924-92e1c4b9a5dd'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.932031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] The token cache is being invalidate because project 409a9bc4cc0a4d1692dc17ccef77376d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:26.932318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.932954 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:26.934531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1405/2791] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:26 2022] DELETE /identity/v3/projects/409a9bc4cc0a4d1692dc17ccef77376d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:26.938948 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.948911 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b053063-d748-4fff-86c3-92a58d416679 service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.008726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.009518 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.009804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.010072 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] PATH_INFO: `/v3/users/029035711359411a888374e0dcd53e8c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.011315 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=029035711359411a888374e0dcd53e8c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.013257 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.035554 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:27.067663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029035711359411a888374e0dcd53e8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.074537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029035711359411a888374e0dcd53e8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.083910 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029035711359411a888374e0dcd53e8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.084612 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029035711359411a888374e0dcd53e8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.098985 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-55e1c2d3-de3a-4279-9819-c0d133cdaf0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029035711359411a888374e0dcd53e8c'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.107385 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1387/2792] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:26 2022] DELETE /identity/v3/users/029035711359411a888374e0dcd53e8c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:27.412689 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:27.415622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:27.433276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8699-013e-48cd-b924-92e1c4b9a5dd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.444176 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:27.500432 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.501308 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.501613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.502059 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] PATH_INFO: `/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.503622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df2b88cada0467cb4ed1ef30d8523f8)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.505541 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.553353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df2b88cada0467cb4ed1ef30d8523f8', 'request_id': 'req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.558731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df2b88cada0467cb4ed1ef30d8523f8', 'request_id': 'req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.564986 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df2b88cada0467cb4ed1ef30d8523f8', 'request_id': 'req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.578864 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] The token cache is being invalidate because project 0df2b88cada0467cb4ed1ef30d8523f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:27.579140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.579789 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b2c1e672-7b96-4e2c-a06b-7883d4a4a08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:27.581349 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1406/2793] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:27 2022] DELETE /identity/v3/projects/0df2b88cada0467cb4ed1ef30d8523f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:27.586812 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.587304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.587449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.606175 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:27.607427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:27.670994 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1388/2794] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:27.681165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.681454 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.681731 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.703016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:27.704396 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:27.714922 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1407/2795] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:27.720066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:27.738855 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e75f4-63c1-4d24-97fe-348bd82e7353 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.744996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.745674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.745957 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.746232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.746960 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:27.747266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.749065 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.762934 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1389/2796] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:27.767868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:27.780931 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe48f6-c592-4d34-a789-be56d554c444 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.788948 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.789606 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.789882 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.790149 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.791117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.793756 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.837901 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1408/2797] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:27 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:27.844323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:27.855186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c7147-7e00-4c94-a942-9fa78b8e1067 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.934121 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.934932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.935215 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.935533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.936224 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.938382 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.960444 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1390/2798] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:27 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:27.964871 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:27.975621 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac0-0b5f-4314-af07-bab880747fd7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:27.980826 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:27.981486 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.981768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.982153 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.982879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:27.984545 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:27.995180 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1409/2799] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:27.999386 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.010443 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd15f9-4c79-447d-8233-55b9eacdb4f9 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.015124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.015845 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.016124 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.016399 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.017135 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.018737 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a733c7d-58e2-4bf7-847e-178940545c9c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.028836 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1391/2800] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:28.033322 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.043937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c23de-00f9-43eb-9faa-4adef12f49c4 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.049484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.050384 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.050660 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.050932 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] PATH_INFO: `/v3/projects/14e68852263c41059e2588365b879dc2/users/7ded023d397f4957ad0598f5e3aeb363/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.068066 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e68852263c41059e2588365b879dc2, user_id=7ded023d397f4957ad0598f5e3aeb363, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.074414 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.095374 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1410/2801] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:28 2022] PUT /identity/v3/projects/14e68852263c41059e2588365b879dc2/users/7ded023d397f4957ad0598f5e3aeb363/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:28.106988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.107320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.107552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.120568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:28.135550 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] MFA Rules not processed for user `7ded023d397f4957ad0598f5e3aeb363`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:28.136765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:28.204218 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1392/2802] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:28.209768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.261520 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:28.292004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e7dd-8008-4dad-9dde-7024c6121ffd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.297609 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.298287 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.298553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.298824 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.299560 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.301468 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.327827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1411/2803] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:28.332511 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.343713 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61002d6-8a82-44cc-aeed-3376dd2c0a5e None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.412468 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.413190 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.413476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.413754 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.414447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.416438 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.439533 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1393/2804] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:28 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:51:28.443996 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.454957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a24f2-183f-4465-a6df-c691594b4c83 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.459767 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.460417 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.460693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.460973 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.461692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.463276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.474184 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1412/2805] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:28.478244 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.488771 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7195-6a30-40b0-a377-42a4c5573446 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.493879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.494758 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.495067 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.495364 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] PATH_INFO: `/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b/users/1205085f2e6c473a81337418f56c24c5/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.510635 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fffc3c7d95d4ff59d783486f0b76e8b, user_id=1205085f2e6c473a81337418f56c24c5, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.513636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.530193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1394/2806] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:28 2022] PUT /identity/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b/users/1205085f2e6c473a81337418f56c24c5/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:28.534388 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.549910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0e69-7ab8-4ef7-99e8-ea54f09d41e0 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.614769 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.615378 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.615680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.615958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.616691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.618333 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c990bf6-cf83-41dc-a9b4-9136dcb07df1 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.628087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1413/2807] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:28.632461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.642896 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87c99-9c50-4718-bcc4-8252a28ca538 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.648198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.649087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.649367 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.649642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] PATH_INFO: `/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b/users/1205085f2e6c473a81337418f56c24c5/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.651804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fffc3c7d95d4ff59d783486f0b76e8b, user_id=1205085f2e6c473a81337418f56c24c5, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.654445 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.665808 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1395/2808] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:28 2022] PUT /identity/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b/users/1205085f2e6c473a81337418f56c24c5/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:28.676103 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.676398 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.676682 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.702999 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] MFA Rules not processed for user `1205085f2e6c473a81337418f56c24c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:28.704218 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:28.783836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1414/2809] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:51:28.796108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:28.797952 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:28.851442 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:28.855405 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8f97-be0b-4d49-a6e5-68a3c3397460 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:28.860966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:28.861621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:28.862134 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:28.862578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:28.871829 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:28.873213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:28.882461 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1396/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:29.200119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:29.210120 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae5b67-8c0e-4548-bf48-186d461bd58d None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:29.215191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1205085f2e6c473a81337418f56c24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fffc3c7d95d4ff59d783486f0b76e8b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:29.215880 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.216165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.216443 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.217206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:29.217498 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:29.219279 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:29.231896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1415/2811] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:29.237108 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:29.246191 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999f460-eba2-4d63-a214-d84253111025 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:29.250958 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1205085f2e6c473a81337418f56c24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fffc3c7d95d4ff59d783486f0b76e8b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:29.251647 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.251909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.252187 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.252874 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:29.254760 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:29.283066 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1397/2812] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:29 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:29.287135 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:29.297580 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2657ee-cd1e-4177-9632-ed3330895534 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:29.315266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:29.357026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1205085f2e6c473a81337418f56c24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fffc3c7d95d4ff59d783486f0b76e8b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:29.357686 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.357971 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.358250 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.359001 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:29.359361 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:29.360976 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:29.372133 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1416/2813] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:29.409552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:29.426231 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397fa5-9108-473c-988c-3ba4e682e239 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:29.433362 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1205085f2e6c473a81337418f56c24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fffc3c7d95d4ff59d783486f0b76e8b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:29.434227 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.434544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.434804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] PATH_INFO: `/v3/projects/7b76881cd5ad44a1a5794a4f3e05f086` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.436126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b76881cd5ad44a1a5794a4f3e05f086)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:29.438616 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:29.489486 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b76881cd5ad44a1a5794a4f3e05f086', 'request_id': 'req-df31eb22-3e89-4d51-b4ba-749ddc31bb97'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.496495 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b76881cd5ad44a1a5794a4f3e05f086', 'request_id': 'req-df31eb22-3e89-4d51-b4ba-749ddc31bb97'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.502234 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b76881cd5ad44a1a5794a4f3e05f086', 'request_id': 'req-df31eb22-3e89-4d51-b4ba-749ddc31bb97'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.513467 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] The token cache is being invalidate because project 7b76881cd5ad44a1a5794a4f3e05f086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:29.513765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.514538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-df31eb22-3e89-4d51-b4ba-749ddc31bb97 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.516319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1398/2814] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:29 2022] DELETE /identity/v3/projects/7b76881cd5ad44a1a5794a4f3e05f086 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:29.713856 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:29.716573 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:29.785631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9522a-fd7b-43b1-b900-6cb9ba418392 tempest-VolumeQuotaClassesTest-601772945 tempest-VolumeQuotaClassesTest-601772945-project-admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:29.844353 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:29.845246 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.845531 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.845815 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] PATH_INFO: `/v3/users/7ded023d397f4957ad0598f5e3aeb363` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.847058 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ded023d397f4957ad0598f5e3aeb363)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:29.849032 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:29.898866 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ded023d397f4957ad0598f5e3aeb363'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.905555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ded023d397f4957ad0598f5e3aeb363'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.906202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ded023d397f4957ad0598f5e3aeb363'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.914982 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ded023d397f4957ad0598f5e3aeb363'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.915768 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ded023d397f4957ad0598f5e3aeb363'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:29.917085 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:29.936274 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1417/2815] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:29 2022] DELETE /identity/v3/users/7ded023d397f4957ad0598f5e3aeb363 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:29.941095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:29.941572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:29.941572 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:29.960854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:29.962070 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:30.029051 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1399/2816] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:30.039075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:30.041371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:30.102485 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcebf9-5fc8-4c1b-bb9b-6d6818494c50 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:30.106683 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:30.107363 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:30.107664 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:30.107944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:30.118206 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:30.119702 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:30.129372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1418/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:30.411943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:30.413455 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:30.426289 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fc01b-119e-46a3-97ea-72c5598c5f0f None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:30.431095 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:30.432013 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:30.432297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:30.432578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] PATH_INFO: `/v3/projects/14e68852263c41059e2588365b879dc2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:30.433824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e68852263c41059e2588365b879dc2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:30.435853 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:30.482394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:30.483924 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e68852263c41059e2588365b879dc2', 'request_id': 'req-435b52ae-b9e7-4dee-8db8-6f355742bf32'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.494389 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e68852263c41059e2588365b879dc2', 'request_id': 'req-435b52ae-b9e7-4dee-8db8-6f355742bf32'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.500674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e68852263c41059e2588365b879dc2', 'request_id': 'req-435b52ae-b9e7-4dee-8db8-6f355742bf32'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.511854 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] The token cache is being invalidate because project 14e68852263c41059e2588365b879dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:30.512139 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.512846 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.514490 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1400/2818] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:30 2022] DELETE /identity/v3/projects/14e68852263c41059e2588365b879dc2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:30.518613 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:30.528816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052b2f9-3f88-4d15-ac7f-e8dd59a0b689 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:30.591142 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:30.592043 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:30.592321 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:30.592593 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] PATH_INFO: `/v3/users/1205085f2e6c473a81337418f56c24c5` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:30.593837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1205085f2e6c473a81337418f56c24c5)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:30.595793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:30.654399 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1205085f2e6c473a81337418f56c24c5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.661119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1205085f2e6c473a81337418f56c24c5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.661782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1205085f2e6c473a81337418f56c24c5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.669845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1205085f2e6c473a81337418f56c24c5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.670671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-313fc6bc-d2a4-46bb-a446-aad528c69461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1205085f2e6c473a81337418f56c24c5'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:30.688343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1419/2819] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:30 2022] DELETE /identity/v3/users/1205085f2e6c473a81337418f56c24c5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:30.972775 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:30.974254 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:30.987670 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b52ae-b9e7-4dee-8db8-6f355742bf32 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.044277 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.045064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.045343 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.045611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] PATH_INFO: `/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.046959 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fffc3c7d95d4ff59d783486f0b76e8b)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.048928 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.099251 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fffc3c7d95d4ff59d783486f0b76e8b', 'request_id': 'req-578b6f77-41bd-4f3e-9d9c-d1f784147815'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:31.108917 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fffc3c7d95d4ff59d783486f0b76e8b', 'request_id': 'req-578b6f77-41bd-4f3e-9d9c-d1f784147815'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:31.117040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fffc3c7d95d4ff59d783486f0b76e8b', 'request_id': 'req-578b6f77-41bd-4f3e-9d9c-d1f784147815'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:31.128712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] The token cache is being invalidate because project 0fffc3c7d95d4ff59d783486f0b76e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:31.128997 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:31.129672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-578b6f77-41bd-4f3e-9d9c-d1f784147815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:31.131241 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1401/2820] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:30 2022] DELETE /identity/v3/projects/0fffc3c7d95d4ff59d783486f0b76e8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:31.136259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.136723 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.136822 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.144007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:31.156957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:31.158983 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.220038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1420/2821] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:31.228133 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.228419 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.228721 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.248094 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:31.249334 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.258803 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1402/2822] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:31.263372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.274156 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cc002-d1a3-491d-92c2-6d84de44f4b7 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.280243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.280900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.281182 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.281457 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.282183 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:31.282490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.284126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.296307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1421/2823] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:31.302434 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.315237 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9386a-b01e-4292-b83b-ae31e54bee54 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.321898 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.322556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.322842 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.323102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.323861 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.325765 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.354968 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1403/2824] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:31.359292 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.369972 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946887d4-fd4b-4149-a237-2077850655a3 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.430575 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.431243 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.431570 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.431847 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.432532 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.434460 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.460395 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1422/2825] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:31.466266 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.479407 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f918-d0f1-410a-97ee-ee8a049e4c29 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.484967 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.485597 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.485900 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.486168 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.486890 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.488537 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.499242 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1404/2826] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:31.503401 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.513919 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f3d30-c52d-4339-a6bb-a5d858bdf58f admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.519323 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.520038 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.520328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.520602 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.521345 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.522961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f9e7c-a935-4ca1-84e8-4ae37fcd7935 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.533596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1423/2827] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:31.537788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.548365 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafd79-a2d2-497a-bc1a-3e1dfbd75e57 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.554196 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.555075 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.555383 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.555663 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] PATH_INFO: `/v3/projects/71be2ee8bccc4650b1118038f58ca76a/users/db52872e9b964748b5899cbeedc289a2/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.571412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be2ee8bccc4650b1118038f58ca76a, user_id=db52872e9b964748b5899cbeedc289a2, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.574118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.590522 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1405/2828] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:31 2022] PUT /identity/v3/projects/71be2ee8bccc4650b1118038f58ca76a/users/db52872e9b964748b5899cbeedc289a2/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:31.595944 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5090-741f-47d8-9cff-14584865c4a8 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.596232 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5090-741f-47d8-9cff-14584865c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.596508 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5090-741f-47d8-9cff-14584865c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.615259 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a4ac5090-741f-47d8-9cff-14584865c4a8 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:31.616487 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a4ac5090-741f-47d8-9cff-14584865c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.673991 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1424/2829] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:31.685384 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.687681 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.695368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:31.759324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ba46-bfe6-48b1-a322-5dee853aebae admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.764667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.765321 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.765603 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.765877 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.777009 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.778476 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.788426 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1406/2830] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:32.405165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.405680 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.405782 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.424433 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:32.434471 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] MFA Rules not processed for user `db52872e9b964748b5899cbeedc289a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:32.436202 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:32.503276 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1425/2831] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:32.508153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.518409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff26f1-7cfd-4e08-9240-65cff7e9a4ca service neutron] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.523188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.523880 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.524165 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.524441 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.525137 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.527048 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.553644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1407/2832] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:51:32.557928 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.569368 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483a99-beb4-4125-a2f1-fef72e17b219 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.625328 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.626004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.626275 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.626553 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.627303 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.629199 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.654636 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1426/2833] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:32 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:32.657195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.667538 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f23b8-6bd1-483d-943b-dc764bcefe8c admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.672633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.673295 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.673581 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.673852 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.674589 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.676246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.686963 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1408/2834] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:32.691898 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.705907 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3632f8b-390b-4e30-9ccf-ca39d13dabc5 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.711572 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.712483 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.712784 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.713052 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] PATH_INFO: `/v3/projects/150605e15ae0423eb59f497b9ded029f/users/1cc3a50dfbb247b490ebd2327e63cd0d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.728688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=150605e15ae0423eb59f497b9ded029f, user_id=1cc3a50dfbb247b490ebd2327e63cd0d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.731387 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.752301 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1427/2835] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:32 2022] PUT /identity/v3/projects/150605e15ae0423eb59f497b9ded029f/users/1cc3a50dfbb247b490ebd2327e63cd0d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:32.756491 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.767415 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b5706-5b2b-48b7-b7b2-6bc5dac35053 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.826328 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.827061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.827252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.827576 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.828387 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.830011 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d8ef-2bb3-48f3-bc4f-0f038c1b0fa4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.840372 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1409/2836] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:51:32.844634 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:32.855677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399bb4-bed0-41cb-87e3-eeb10cdf5ccc admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:32.862894 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:32.864244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:32.864780 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:32.865082 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] PATH_INFO: `/v3/projects/150605e15ae0423eb59f497b9ded029f/users/1cc3a50dfbb247b490ebd2327e63cd0d/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:32.868146 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=150605e15ae0423eb59f497b9ded029f, user_id=1cc3a50dfbb247b490ebd2327e63cd0d, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:32.872251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:32.888603 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1428/2837] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:32 2022] PUT /identity/v3/projects/150605e15ae0423eb59f497b9ded029f/users/1cc3a50dfbb247b490ebd2327e63cd0d/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:33.511703 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:33.512250 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:33.512797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:33.539305 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] MFA Rules not processed for user `1cc3a50dfbb247b490ebd2327e63cd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:33.540545 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:33.601857 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:33.613052 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1410/2838] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:33.623995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:33.625755 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:33.684095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab20d8-65c1-4ee5-bed3-1e38049772bd admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:33.688054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:33.688704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:33.688985 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:33.689255 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:33.693488 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:33.762937 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:33.764429 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:33.773622 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1429/2839] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:35.131531 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:35.133193 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:35.146966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b3a6a-a745-431a-8e65-6c23cc104b55 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:35.151623 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:35.152268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:35.152556 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:35.152811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:35.165409 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:35.167496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:35.179297 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1411/2840] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:43.769832 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=25 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:45.175101 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=9 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:47.750638 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:47.752300 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:47.831215 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32565-3182-434d-92df-a1b9bc0e8070 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:47.836728 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:47.837342 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:47.837624 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:47.837900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:47.839843 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:47.851656 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:47.853252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:47.863831 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1430/2841] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:48.539902 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:48.603351 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a9a0-d2fb-48f4-859a-76d97193d2a2 service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:48.609040 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:48.610033 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:48.610310 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:48.610561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] PATH_INFO: `/v3/users/db52872e9b964748b5899cbeedc289a2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:48.612073 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db52872e9b964748b5899cbeedc289a2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:48.614023 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:48.664100 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db52872e9b964748b5899cbeedc289a2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:48.671605 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db52872e9b964748b5899cbeedc289a2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:48.680795 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db52872e9b964748b5899cbeedc289a2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:48.681987 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db52872e9b964748b5899cbeedc289a2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:48.695188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db52872e9b964748b5899cbeedc289a2'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:48.701264 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1412/2842] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:48 2022] DELETE /identity/v3/users/db52872e9b964748b5899cbeedc289a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:48.889799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:48.900858 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f842-d033-44b4-ba84-b9d0c2381ca4 service placement] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:48.961629 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:48.962506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:48.962785 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:48.963054 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] PATH_INFO: `/v3/projects/71be2ee8bccc4650b1118038f58ca76a` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:48.964327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71be2ee8bccc4650b1118038f58ca76a)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:48.966236 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.017625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71be2ee8bccc4650b1118038f58ca76a', 'request_id': 'req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.023552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71be2ee8bccc4650b1118038f58ca76a', 'request_id': 'req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.029707 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71be2ee8bccc4650b1118038f58ca76a', 'request_id': 'req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.043631 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] The token cache is being invalidate because project 71be2ee8bccc4650b1118038f58ca76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:49.043914 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.044568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.046131 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1431/2843] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:48 2022] DELETE /identity/v3/projects/71be2ee8bccc4650b1118038f58ca76a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:51:49.050221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.051837 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:49.064946 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0992d-582b-4f1c-bdf6-8a16c585c590 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.121772 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.122655 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.122925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.123206 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] PATH_INFO: `/v3/users/1cc3a50dfbb247b490ebd2327e63cd0d` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.124428 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc3a50dfbb247b490ebd2327e63cd0d)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.126480 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.149041 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:49.176291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc3a50dfbb247b490ebd2327e63cd0d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.182894 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc3a50dfbb247b490ebd2327e63cd0d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.190223 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc3a50dfbb247b490ebd2327e63cd0d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.190979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc3a50dfbb247b490ebd2327e63cd0d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.202804 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d722df5-b498-40e9-a773-11fcb407c621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc3a50dfbb247b490ebd2327e63cd0d'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.210064 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1413/2844] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:49 2022] DELETE /identity/v3/users/1cc3a50dfbb247b490ebd2327e63cd0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:49.409886 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.411463 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:49.427289 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cfb99-ea4d-4ca0-bb29-11ea52627b76 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.444879 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:49.486640 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.487537 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.487810 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.488077 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] PATH_INFO: `/v3/projects/150605e15ae0423eb59f497b9ded029f` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.489244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150605e15ae0423eb59f497b9ded029f)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.491207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.538140 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150605e15ae0423eb59f497b9ded029f', 'request_id': 'req-547b105d-e938-4270-b748-e670f882f8a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.543677 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150605e15ae0423eb59f497b9ded029f', 'request_id': 'req-547b105d-e938-4270-b748-e670f882f8a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.549694 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150605e15ae0423eb59f497b9ded029f', 'request_id': 'req-547b105d-e938-4270-b748-e670f882f8a8'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.563217 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] The token cache is being invalidate because project 150605e15ae0423eb59f497b9ded029f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:49.563539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.564165 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-547b105d-e938-4270-b748-e670f882f8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:49.565744 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1432/2845] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:49 2022] DELETE /identity/v3/projects/150605e15ae0423eb59f497b9ded029f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:49.570869 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.571457 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.571638 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.590552 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:49.591806 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:49.658579 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1414/2846] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:49.672109 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.672392 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.672671 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.701494 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:49.702961 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:49.717842 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1433/2847] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:49.723123 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.738232 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca396bb-4b43-4b8e-b2cb-5413beae0d93 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.747298 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.748293 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.748649 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.748979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.750115 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:49.750462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.752182 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.765087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1415/2848] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:51:49.769555 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.779127 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83848e80-b618-4675-b946-f01ccc8181ee None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.785237 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.785884 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.786160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.786426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.787113 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.789031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.820093 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1434/2849] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:49.824002 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.835694 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d7cb5-f11f-4b65-914a-de9b1037e4ae admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.898672 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.900054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.900054 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.900246 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.900909 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.902932 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.924504 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1416/2850] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:49 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:49.928431 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.939284 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df161-fe69-453e-9a5d-f28bd788924b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.944777 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.945444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.945727 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.945995 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.946715 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.948355 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.959653 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1435/2851] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:49.963583 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:49.974788 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47b38-fd30-4fc6-92f6-7f09d045468a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:49.980144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:49.980797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:49.981081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:49.981354 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:49.982068 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:49.983729 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c63268-85f8-4023-bf02-8c9fb8746ed4 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:49.993646 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1417/2852] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:49.999119 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.011519 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df572b-2d33-4f97-9751-3bbfec4176a6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.017356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.018252 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.018534 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.018809 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] PATH_INFO: `/v3/projects/b93ded89c06945989c6056788722f8c0/users/c388bbc2ad0c4b8291af47a13c5a0ff4/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.034957 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93ded89c06945989c6056788722f8c0, user_id=c388bbc2ad0c4b8291af47a13c5a0ff4, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.037742 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.052909 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1436/2853] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:49 2022] PUT /identity/v3/projects/b93ded89c06945989c6056788722f8c0/users/c388bbc2ad0c4b8291af47a13c5a0ff4/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:50.063996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.064482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.064759 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.072062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:50.097320 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] MFA Rules not processed for user `c388bbc2ad0c4b8291af47a13c5a0ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:50.098526 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:50.163492 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1418/2854] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:50.168073 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.218330 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:50.234655 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a68cc-f9a0-4908-a68c-ecfda1d549b6 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.239670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.240327 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.240612 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.240889 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.241588 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.243561 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.271019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1437/2855] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:50.275268 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.286229 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1a027-d2e7-47af-afb1-b2c67f2f6b04 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.343154 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.343885 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.344186 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.344471 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.345156 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.347126 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.372507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1419/2856] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:50.376607 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.386855 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d054d0-98d3-4ef0-8881-43b132871bca admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.391758 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.392449 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.392735 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.393007 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.393764 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.395413 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.406474 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1438/2857] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:50.410784 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.425940 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f771b-69c7-4487-ae82-f446e430110b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.434636 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.435566 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.435897 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.436259 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.437337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.439032 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ddb6-bdf7-4945-9694-efff3f6fe3bc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.449483 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1420/2858] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:51:50.453704 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.464778 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5cd7-90e0-43fc-ac6e-a848d98e3670 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.470818 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.471667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.471946 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.472251 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] PATH_INFO: `/v3/projects/f071b1be881241058a9b6577ad921951/users/4e80a1ce4e684842be8c0213f75138a0/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.488836 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f071b1be881241058a9b6577ad921951, user_id=4e80a1ce4e684842be8c0213f75138a0, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.491490 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.506448 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1439/2859] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:50 2022] PUT /identity/v3/projects/f071b1be881241058a9b6577ad921951/users/4e80a1ce4e684842be8c0213f75138a0/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:50.516954 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.517238 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.517512 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.544876 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] MFA Rules not processed for user `4e80a1ce4e684842be8c0213f75138a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:50.546092 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:50.617459 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1421/2860] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:50.622136 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.685916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58313e-ded0-4cf1-8692-abbe55674fd7 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.691224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.691900 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.692178 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.692450 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.693126 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.695012 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.723835 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1440/2861] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:50.728412 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.736561 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:50.743971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072986-be61-4a7b-b335-43a681863ef7 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.801366 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.802038 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.802323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.802593 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] PATH_INFO: `/v3/users` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.803284 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.805262 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.829975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1422/2862] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:50 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:50.834477 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.845334 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898781-7320-4d61-9793-bfa496da0e12 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.851075 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.851766 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.852050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.852325 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.853037 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.854662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.865852 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1441/2863] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:50.870144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.880529 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e7af-834f-4118-b72f-f1e192f8bc2d admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.885331 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.886212 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.886496 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.886769 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] PATH_INFO: `/v3/projects/177a6d9f9ea744929393a7576e5b3b7c/users/e4e0c2d6a27a4285ae2566eaaa2e54e9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.901456 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=177a6d9f9ea744929393a7576e5b3b7c, user_id=e4e0c2d6a27a4285ae2566eaaa2e54e9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.904153 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:50.918337 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1423/2864] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:50 2022] PUT /identity/v3/projects/177a6d9f9ea744929393a7576e5b3b7c/users/e4e0c2d6a27a4285ae2566eaaa2e54e9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:50.922331 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:50.932190 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e548bf-2ec6-44ff-8b25-6fe3df348e17 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:50.996129 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:50.996748 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:50.997031 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:50.997307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:50.998027 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:50.999667 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855cd0a-7f2b-48cd-b667-1ed0c6d5f83d admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:51.009857 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1442/2865] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:51.013956 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:51.028197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b4a8-d803-4aa2-b716-418ca0c8b44b admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:51.033559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:51.034447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:51.034726 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:51.035001 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] PATH_INFO: `/v3/projects/177a6d9f9ea744929393a7576e5b3b7c/users/e4e0c2d6a27a4285ae2566eaaa2e54e9/roles/77bb21c1be16493181bb82f412685ca2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:51.037105 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=177a6d9f9ea744929393a7576e5b3b7c, user_id=e4e0c2d6a27a4285ae2566eaaa2e54e9, role_id=77bb21c1be16493181bb82f412685ca2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:51.039786 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:51.051171 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1424/2866] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:51 2022] PUT /identity/v3/projects/177a6d9f9ea744929393a7576e5b3b7c/users/e4e0c2d6a27a4285ae2566eaaa2e54e9/roles/77bb21c1be16493181bb82f412685ca2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:51.119102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:51.119411 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:51.119693 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:51.132538 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:51.148078 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] MFA Rules not processed for user `e4e0c2d6a27a4285ae2566eaaa2e54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:51.149307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:51.223705 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1443/2867] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:51.236102 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:51.238449 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:51.299745 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268b193-9526-4267-bb32-fe9ef120f39a admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:51.304036 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:51.304674 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:51.305097 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:51.305582 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:51.364667 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:51.366132 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:51.375226 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1425/2868] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:52.878191 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:52.879861 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:52.892813 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17350-45a6-473d-a72d-98c30cf429af None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:52.896662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:52.897299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:52.897574 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:52.897845 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:52.955379 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:52.956837 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:52.966819 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1444/2869] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:53.502585 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:53.511831 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda727-82f3-45a8-8291-eb7ec08df69d service cinder] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:53.515938 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:53.516578 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.516858 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.517131 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.526433 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:53.529184 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:53.530867 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237026-d811-4cf2-93f9-2e519d991c73 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:53.542688 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1426/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:57.448381 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:57.515117 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57682-2dd3-40f3-95d1-549726c6aa65 service cinder] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:57.520382 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:57.521257 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:57.521539 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:57.521811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] PATH_INFO: `/v3/users/c388bbc2ad0c4b8291af47a13c5a0ff4` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:57.523094 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c388bbc2ad0c4b8291af47a13c5a0ff4)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:57.525019 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:57.561691 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:57.574974 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c388bbc2ad0c4b8291af47a13c5a0ff4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:57.582050 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c388bbc2ad0c4b8291af47a13c5a0ff4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:57.583026 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c388bbc2ad0c4b8291af47a13c5a0ff4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:57.591188 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c388bbc2ad0c4b8291af47a13c5a0ff4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:57.591939 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c388bbc2ad0c4b8291af47a13c5a0ff4'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:57.610358 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1445/2871] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:57 2022] DELETE /identity/v3/users/c388bbc2ad0c4b8291af47a13c5a0ff4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:57.614936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:57.615451 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:57.615568 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:57.632469 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:57.633595 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:57.697058 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1427/2872] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:57.706811 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:57.708841 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:57.766595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c34-8033-4117-bfc7-ef6eb3a0683b admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:57.770740 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:57.771406 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:57.771688 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:57.771962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:57.781296 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:57.782776 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:57.792372 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1446/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:58.063323 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:58.064828 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:58.078976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3d773-6562-40bd-8950-4a2509e48e2d None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:58.085340 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:58.086652 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:58.087026 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:58.087299 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] PATH_INFO: `/v3/projects/b93ded89c06945989c6056788722f8c0` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:58.092690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93ded89c06945989c6056788722f8c0)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:58.092690 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:58.138642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93ded89c06945989c6056788722f8c0', 'request_id': 'req-da819248-bd3f-4cb2-a01c-cac35c03c0e6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.146966 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93ded89c06945989c6056788722f8c0', 'request_id': 'req-da819248-bd3f-4cb2-a01c-cac35c03c0e6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.152342 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93ded89c06945989c6056788722f8c0', 'request_id': 'req-da819248-bd3f-4cb2-a01c-cac35c03c0e6'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.163096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] The token cache is being invalidate because project b93ded89c06945989c6056788722f8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:58.163410 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.164120 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.165777 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1428/2874] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:58 2022] DELETE /identity/v3/projects/b93ded89c06945989c6056788722f8c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:58.169830 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:58.179578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62095-d98b-413d-a8ef-6900efc57946 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:58.236581 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:58.237458 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:58.237741 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:58.238016 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] PATH_INFO: `/v3/users/4e80a1ce4e684842be8c0213f75138a0` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:58.239234 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e80a1ce4e684842be8c0213f75138a0)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:58.241224 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:58.294578 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e80a1ce4e684842be8c0213f75138a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.300102 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:58.302403 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e80a1ce4e684842be8c0213f75138a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.303364 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e80a1ce4e684842be8c0213f75138a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.312170 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e80a1ce4e684842be8c0213f75138a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.313198 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e80a1ce4e684842be8c0213f75138a0'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.330670 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1447/2875] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:58 2022] DELETE /identity/v3/users/4e80a1ce4e684842be8c0213f75138a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:58.613971 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:58.615479 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:58.628789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da819248-bd3f-4cb2-a01c-cac35c03c0e6 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:58.694783 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:58.696037 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:58.696319 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:58.696580 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] PATH_INFO: `/v3/projects/f071b1be881241058a9b6577ad921951` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:58.697904 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f071b1be881241058a9b6577ad921951)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:58.700484 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:58.724824 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:58.759879 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f071b1be881241058a9b6577ad921951', 'request_id': 'req-e389193a-649d-48fe-8304-df78b898e0b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.768559 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f071b1be881241058a9b6577ad921951', 'request_id': 'req-e389193a-649d-48fe-8304-df78b898e0b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.774089 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f071b1be881241058a9b6577ad921951', 'request_id': 'req-e389193a-649d-48fe-8304-df78b898e0b0'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.786118 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] The token cache is being invalidate because project f071b1be881241058a9b6577ad921951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:58.786406 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.787081 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.788697 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1429/2876] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:58 2022] DELETE /identity/v3/projects/f071b1be881241058a9b6577ad921951 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:58.792883 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:58.794637 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:58.808207 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa021-ae70-49d5-976c-d2b203adcbec admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:58.868447 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:58.869318 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:58.869598 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:58.869868 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] PATH_INFO: `/v3/users/e4e0c2d6a27a4285ae2566eaaa2e54e9` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:58.871160 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e0c2d6a27a4285ae2566eaaa2e54e9)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:58.873106 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:58.922592 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e0c2d6a27a4285ae2566eaaa2e54e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.929397 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e0c2d6a27a4285ae2566eaaa2e54e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.930087 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e0c2d6a27a4285ae2566eaaa2e54e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.938662 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e0c2d6a27a4285ae2566eaaa2e54e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.939299 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-87e8dc85-e6f9-4f69-b73e-c01223ea01a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e0c2d6a27a4285ae2566eaaa2e54e9'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:58.956095 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1448/2877] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:58 2022] DELETE /identity/v3/users/e4e0c2d6a27a4285ae2566eaaa2e54e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:59.239656 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.241099 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:59.255304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389193a-649d-48fe-8304-df78b898e0b0 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.315544 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.316423 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.316704 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.316979 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] PATH_INFO: `/v3/projects/177a6d9f9ea744929393a7576e5b3b7c` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.318207 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=177a6d9f9ea744929393a7576e5b3b7c)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.320169 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.368055 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177a6d9f9ea744929393a7576e5b3b7c', 'request_id': 'req-e45da2fc-c3e2-4150-abb6-67469fc85a7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:59.378622 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177a6d9f9ea744929393a7576e5b3b7c', 'request_id': 'req-e45da2fc-c3e2-4150-abb6-67469fc85a7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:59.387394 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177a6d9f9ea744929393a7576e5b3b7c', 'request_id': 'req-e45da2fc-c3e2-4150-abb6-67469fc85a7b'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:59.404285 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] The token cache is being invalidate because project 177a6d9f9ea744929393a7576e5b3b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:59.404666 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:59.405621 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-e45da2fc-c3e2-4150-abb6-67469fc85a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:59.407757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1430/2878] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:59 2022] DELETE /identity/v3/projects/177a6d9f9ea744929393a7576e5b3b7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:59.413666 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.413962 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.414240 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.432408 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:59.433625 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:59.489030 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:59.504658 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1449/2879] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:59.512610 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.512906 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.513188 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.532062 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:59.533291 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:59.542304 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1431/2880] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:59.546805 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.556977 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4ef5c-7be7-4b99-b49a-acaa4e1dc9f5 None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.562729 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.563568 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.563844 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.564112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.564816 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:59.565506 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.566695 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.578850 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1450/2881] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:59.585611 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.600644 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd652ed-2ba5-4a6b-ab40-b7b93d876e14 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.609507 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.610429 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.610712 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.610988 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.611873 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.613797 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.642811 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1432/2882] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:59 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:59.646981 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.657339 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32922e-cb4d-4e59-97b1-af7a1f67d9fe admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.715410 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.716083 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.716394 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.716673 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.717343 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.719268 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.740752 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1451/2883] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:59 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:59.744794 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.756144 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126498f-e1b0-4e0f-bb53-feb746181b01 admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.761976 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.762643 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.762925 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.763198 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.763975 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.765599 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.771087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:59.780082 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1433/2884] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:59.781604 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.792438 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7430-fcda-4515-9a18-bf4cf12a0e31 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.797418 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.798112 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.798371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.798645 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] PATH_INFO: `/v3/roles` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.799426 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.801004 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21cd79-c01d-473c-8bf0-3182ea65efac admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.810942 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1452/2885] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:59.815311 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.825473 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54ff1-9a2e-4531-8131-5c31f10bd2ae admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:59.830757 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:59.831661 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.831943 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.832213 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] PATH_INFO: `/v3/projects/09e82e93c38e48bbaaeecbff102d50f2/users/537ff5bc92bf4ef68cf243b00dff0a43/roles/0923251e0e694650be6c27d7aafe4826` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.848416 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e82e93c38e48bbaaeecbff102d50f2, user_id=537ff5bc92bf4ef68cf243b00dff0a43, role_id=0923251e0e694650be6c27d7aafe4826)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:59.851178 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:59.866892 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1434/2886] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:59 2022] PUT /identity/v3/projects/09e82e93c38e48bbaaeecbff102d50f2/users/537ff5bc92bf4ef68cf243b00dff0a43/roles/0923251e0e694650be6c27d7aafe4826 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:59.878600 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] REQUEST_METHOD: `POST` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:59.878892 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:59.879173 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:59.906965 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.auth.core [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] MFA Rules not processed for user `537ff5bc92bf4ef68cf243b00dff0a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:59.908266 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:59.974793 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1453/2887] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:51:59.986462 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:59.988482 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:00.048936 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0845d31-b208-476e-9b2a-702977fb92cc admin admin] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:00.053136 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e47a97beb009467b9b53222ba5a551fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:00.053813 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] REQUEST_METHOD: `GET` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.054096 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.054368 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.063996 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:00.065447 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb49f1-fd1c-443e-8db1-73b6aee86361 service cinder] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:00.075221 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1435/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:00.101187 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:00.150356 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:00.167916 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b2c8-5b5f-4c11-826d-d31915ea035a None None] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:00.173114 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:00.173997 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.174277 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.174552 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] PATH_INFO: `/v3/users/537ff5bc92bf4ef68cf243b00dff0a43` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.175799 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537ff5bc92bf4ef68cf243b00dff0a43)` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:00.177698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:00.226627 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537ff5bc92bf4ef68cf243b00dff0a43'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.233444 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537ff5bc92bf4ef68cf243b00dff0a43'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.234172 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537ff5bc92bf4ef68cf243b00dff0a43'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.242862 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537ff5bc92bf4ef68cf243b00dff0a43'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.243595 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.notifications [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537ff5bc92bf4ef68cf243b00dff0a43'} {{(pid=80370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.262123 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1454/2889] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:00 2022] DELETE /identity/v3/users/537ff5bc92bf4ef68cf243b00dff0a43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:00.266789 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] REQUEST_METHOD: `POST` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.267078 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.267324 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.284888 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.auth.core [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] MFA Rules not processed for user `2dee5b081bb1404bb27ed23c7dae2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:00.286087 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:00.344755 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1436/2890] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 23 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:00.354307 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:00.355801 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:00.425692 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e69cd4-9761-48ea-b4c6-c34259646105 admin admin] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:00.429896 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb912f209ff452583ce16ca36ae1967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:00.430544 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.430827 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.431104 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.440476 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:00.441910 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:00.451567 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1455/2891] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:00.741272 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] Authenticating user token {{(pid=80371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:00.742923 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.fernet_utils [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:00.758633 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfbb6a-292f-488a-b10b-6848b6d6d169 None None] Validating token access rules against request {{(pid=80371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:00.764195 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dee5b081bb1404bb27ed23c7dae2bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8652e385f24bd9be7726e25f653946', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:00.765785 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.766642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.766642 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] PATH_INFO: `/v3/projects/09e82e93c38e48bbaaeecbff102d50f2` {{(pid=80371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.767949 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e82e93c38e48bbaaeecbff102d50f2)` {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:00.770079 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] RBAC: Authorization granted {{(pid=80371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:00.820933 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e82e93c38e48bbaaeecbff102d50f2', 'request_id': 'req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.829355 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e82e93c38e48bbaaeecbff102d50f2', 'request_id': 'req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.835252 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e82e93c38e48bbaaeecbff102d50f2', 'request_id': 'req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5'} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.846197 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] The token cache is being invalidate because project 09e82e93c38e48bbaaeecbff102d50f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:00.846427 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.847061 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG keystone.notifications [None req-1d5f96e3-82cc-43c6-8e8e-a85638e241d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:00.848600 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: [pid: 80371|app: 0|req: 1437/2892] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:00 2022] DELETE /identity/v3/projects/09e82e93c38e48bbaaeecbff102d50f2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:10.447371 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:10.843404 dv-cinder-815582-10-iscsi devstack@keystone.service[80371]: DEBUG dbcounter [-] [80371] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:33.123936 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] Authenticating user token {{(pid=80370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:33.125596 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:33.275189 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff462cc-4420-4661-93a1-bd3904371503 service neutron] Validating token access rules against request {{(pid=80370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:33.343484 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f162edbf8449589dcb9cf2bbd8cf1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dafa1feb40ac418d998266bb876614a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:33.344141 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] REQUEST_METHOD: `GET` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:33.344422 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] SCRIPT_NAME: `/identity` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:33.344698 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:33.346869 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.fernet_utils [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:33.359121 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:33.360817 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb661b-9ef1-4d48-a8fc-f1550d4efef9 service placement] RBAC: Authorization granted {{(pid=80370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:33.371244 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: [pid: 80370|app: 0|req: 1456/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:43.366958 dv-cinder-815582-10-iscsi devstack@keystone.service[80370]: DEBUG dbcounter [-] [80370] Writing DB stats keystone:SELECT=89 {{(pid=80370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}